Method and system for displaying object, and method and system for providing the object

ABSTRACT

A first device for displaying an object related to content reproduced by a second device is provided. The first device including a sensor which senses an exit of the first device from a service zone of the second device during reproduction of the content by the second device; a communication device which requests a management server for an object related to the content, the object including link information for receiving information about the content reproduced by the second device at a point of time when the sensor senses the exit, and for receiving the object related to the content from the management server; and a controller which controls a display to display the received object related to the content on a predetermined screen of the first device.

RELATED APPLICATIONS

This application is a continuation application of U.S. patentapplication Ser. No. 15/390,158, which is a continuation application ofU.S. patent application Ser. No. 14/169,182, filed Jan. 31, 2014 (whichwill issue as U.S. Pat. No. 9,531,819, dated Dec. 27, 2016), whichclaims priority from Korean Patent Application Nos. 10-2013-0011492,filed on Jan. 31, 2013, and 10-2013-0085680, filed on Jul. 19, 2013 inthe Korean Intellectual Property Office, the disclosures of which areincorporated herein by reference in their entireties.

BACKGROUND 1. Field

Methods and apparatuses consistent with the exemplary embodiments relateto a method of displaying, on a screen, an object that is related tocontent reproduced by a second device, and a method and system forproviding the object related to the content reproduced by the seconddevice to the first device, the method and system performed by thesecond device or a management server.

2. Description of the Related Art

Due to the developments in communication and display technologies, userssee various types of content that are provided in public places. Forexample, a user may check various administrative procedures, productinformation, information about using various facilities, touristinformation about surrounding areas, or the like on a display device(e.g., a kiosk) equipped in public places such as a government agency, alocal government entity, a department store, an airport, or a railwaystation. Also, the user may view movie content on a display deviceavailable in an airplane or an express bus, or may view broadcastingcontent such as the news on a display device available at a platform ora waiting room.

Because the user may not remain in the public place, the user has todiscontinue viewing of the content reproduced in the public place, andthen move to a different location.

Thus, there is a demand for a system that allows a user, after the userexits the public place, to continuously use a service that was providedin the public place, on a personal terminal of the user.

SUMMARY

One or more exemplary embodiments provide a method and system forproviding via a first device a recommendation item related to contentreproduced by a second device to a user of the first device, wherein theuser has been viewing the content and then exits a service zone of thesecond device.

According to one or more exemplary embodiments, a first deviceconfigured to display at least one object related to content reproducedby a second device, the first device comprises a sensor configured tosense an exit of the first device from a service zone of the seconddevice during reproduction of the content by the second device; acommunication device configured to request, from a management server, anobject related to the content, the object including link information forreceiving information about the content reproduced by the second deviceat a point of time when the sensor senses the exit of the first device,and configured to receive the object related to the content from themanagement server; and a controller configured to control a display todisplay the received object related to the content on a predeterminedscreen of the first device.

According to another aspect of the exemplary embodiments, a managementserver includes a communication device configured to, if a first deviceexits a service zone of a second device reproducing content, receivefrom the first device request information for requesting an objectrelated to the content, request the second device for information aboutthe content reproduced by the second device at a point of time when thefirst device exits the service zone of the second device, and receivethe information about the content from the second device; and acontroller configured to generate the object related to the contentbased on the information about the content, and transmit the generatedobject related to the content via the communication device to the firstdevice.

According to another aspect of the exemplary embodiments, a first deviceconfigured to display an object related to content reproduced by asecond device includes a communication device configured to receive anobject related to content reproduced by the second device, from thesecond device in a predetermined cycle, the object including linkinformation for receiving information about the content; and a sensorconfigured to sense an exit of the first device from a service zone ofthe second device during reproduction of the content by the seconddevice; and a controller configured to control a display to display theobject related to the content on a predetermined screen of the firstdevice at a point of time when the exit of the first device is sensed.

According to another aspect of the exemplary embodiments, a first deviceconfigured to display an object related to content reproduced by asecond device includes a communication device configured to receiveinformation about content reproduced by the second device, from thesecond device when the first device is in a service zone of the seconddevice; a sensor configured to sense an exit of the first device fromthe service zone of the second device during reproduction of the contentby the second device; a controller configured to generate the objectrelated to the content based on the received information about thecontent at a point of time when the exit is sensed; and a displayconfigured to display the generated object related to the content on apredetermined screen of the first device.

According to another aspect of the exemplary embodiments, a method,performed by a first device, of displaying an object related to contentreproduced by a second device comprises sensing an exit of the firstdevice from a service zone of the second device during reproduction ofthe content by the second device; requesting a management server for anobject related to the content, the object including link information forreceiving information about the content reproduced by the second deviceat a point of time when a sensor senses the exit of the first devicefrom the service zone of the second device; receiving the object relatedto the content from the management server; and displaying the receivedobject related to the content on a predetermined screen of the firstdevice.

According to another aspect of the exemplary embodiments, a method,performed by a management server, of providing an object, comprises, ifa first device exits a service zone of a second device reproducingcontent, receiving from the first device request information forrequesting an object related to the content; requesting the seconddevice for information about the content reproduced by the second deviceat a point of time when the first device exits the service zone of thesecond device; receiving the information about the content from thesecond device; generating the object related to the content based on theinformation about the content; and transmitting the generated objectrelated to the content to the first device.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings in which:

FIG. 1 is a diagram of an object providing system according to anexemplary embodiment;

FIG. 2 is a flowchart of a method of displaying a recommendation item,the method performed by a first device, according to an exemplaryembodiment;

FIG. 3 illustrates a method of displaying a recommendation item, themethod performed by the first device, according to another exemplaryembodiment;

FIG. 4 is a flowchart of a method of displaying a recommendation itemafter the first device performs a context analysis, the method performedby the first device, according to an exemplary embodiment;

FIG. 5 is a flowchart of a method of providing a recommendation item,the method performed by a management server, according to an exemplaryembodiment;

FIG. 6 is a flowchart of a method of displaying a recommendation item,the method performed by the first device, according to another exemplaryembodiment;

FIG. 7 is a flowchart of a method of displaying a recommendation item,the method performed by the first device, according to another exemplaryembodiment;

FIG. 8 is a flowchart of a method of providing a recommendation item,the method performed by a second device, according to an exemplaryembodiment;

FIG. 9 illustrates a method of displaying a recommendation item, themethod performed by the first device, according to another exemplaryembodiment;

FIG. 10 is a flowchart of a method of displaying a recommendation item,the method performed by the first device, according to another exemplaryembodiment;

FIGS. 11A and 11B illustrate screens for displaying one or morerecommendation items, according to an exemplary embodiment;

FIGS. 12A, 12B and 12C illustrate a method of receiving a recommendationitem from an external device and displaying the recommendation item, themethod performed by the first device, according to an exemplaryembodiment;

FIGS. 13A through 13C illustrate a method of sharing a recommendationitem with an external device, the method performed by the first device,according to an exemplary embodiment;

FIGS. 14A and 14B illustrate a method of providing a recommendation itemrelated to content reproduced by public transportation, the methodperformed by the first device, according to an exemplary embodiment;

FIGS. 15A, 15B, and 15C illustrate a method of providing arecommendation item related to movie content shown in a theater, themethod performed by the first device, according to an exemplaryembodiment;

FIGS. 16A, 16B, 16C and 16D illustrate a method of providing arecommendation item related to sports content played in a sportscomplex, according to an exemplary embodiment;

FIGS. 17A and 17B are block diagrams illustrating a configuration of thefirst device, according to an exemplary embodiment;

FIG. 18 is a block diagram illustrating a configuration of the seconddevice according to an exemplary embodiment; and

FIG. 19 is a block diagram illustrating a configuration of a managementserver according to an exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

All terms including descriptive or technical terms which are used hereinshould be construed as having meanings that are obvious to one ofordinary skill in the art. However, the terms may have differentmeanings according to an intention of one of ordinary skill in the art,precedent cases, or the appearance of new technologies. Also, some termsmay be arbitrarily selected by the applicant, and in this case, themeaning of the selected terms will be described in detail in thedetailed description of the exemplary embodiments. Thus, the terms usedherein have to be defined based on the meaning of the terms togetherwith the description throughout the specification.

Also, when a part “includes” or “comprises” an element, unless there isa particular description contrary thereto, the part may further includeother elements, not excluding the other elements. In the followingdescription, terms such as “unit” and “module” indicate a unit forprocessing at least one function or operation, wherein the unit and theblock may be embodied as hardware or software or may be embodied bycombining hardware and software.

Throughout the specification, the term “first screen” means a screenthat first displays on a device when the device is turned on, a lock onthe device is unlocked, or an operation mode of the device is switchedfrom a standby mode to an active mode. In one or more exemplaryembodiments, the first screen may be, but is not limited to, a homescreen of the device, a menu screen of the device, or a backgroundscreen of the device. In one or more exemplary embodiments, the firstscreen may be a gateway for the device to provide a service. Forexample, the device may provide a recommended service via the firstscreen.

One or more exemplary embodiments will now be described more fully withreference to the accompanying drawings. However, the one or moreexemplary embodiments may be embodied in many different forms, andshould not be construed as being limited to the exemplary embodimentsset forth herein; rather, these exemplary embodiments are provided sothat this disclosure will be thorough and complete, and will fullyconvey the concept of the one or more exemplary embodiments to those ofordinary skill in the art. In the following description, well-knownfunctions or constructions are not described in detail since they wouldobscure the one or more exemplary embodiments with unnecessary detail,and like reference numerals in the drawings denote like or similarelements throughout the specification.

Expressions such as “at least one of,” when preceding a list ofelements, modify the entire list of elements and do not modify theindividual elements of the list.

FIG. 1 is a diagram of an object providing system according to anexemplary embodiment.

As illustrated in FIG. 1, the object providing system may include afirst device 100, a second device 200, and a management server 300.However, not all shown elements are necessary elements. That is, theobject providing system may be embodied with more or less elements thanthe shown elements. For example, in other exemplary embodiments, themanagement server 300 may be or may not be included in the objectproviding system. First, the exemplary embodiment in which the objectproviding system includes the management server 300 will now bedescribed, and then another exemplary embodiment in which the objectproviding system does not include the management server 300 will bedescribed later with reference to FIGS. 6 through 10.

The first device 100 may be a device that displays an object related tocontent reproduced by an external device (e.g., a public device).Hereinafter, ‘the object related to content’ may be expressed as a‘recommendation item related to content’. In the present exemplaryembodiment, the object related to content may include link informationfor receiving information related to the content. Here, ‘the informationrelated to the content’ may be expressed as ‘the information about thecontent’.

The first device 100 may be a personal mobile device. The first device100 may be variously embodied. For example, throughout thespecification, the first device 100 may be, but is not limited to, amobile phone, a smartphone, a laptop computer, a tablet PC, anelectronic book terminal, a terminal for digital broadcast, a personaldigital assistant (PDA), a portable multimedia player (PMP), anavigation device, an MP3 player, and a digital camera. The first device100 may be a wearable device that a user may wear. For example, thefirst device 100 may be a wristwatch, glasses, a ring, a bracelet, anecklace, or the like, but not limited thereto.

The first device 100 may be positioned in a service zone of the seconddevice 200 and may exit the service zone. The service zone of the seconddevice 200 means an area where the second device 200 may provide aservice to a user or another device. For example, the service zone ofthe second device 200 may include an area where the second device 200may provide a communication service, an area where the second device 200may provide a content reproduction service, or the like.

When the first device 100 is positioned in the service zone of thesecond device 200, the first device 100 may perform communication withthe second device 200. For example, the first device 100 may performshort-distance communication with the second device 200. Examples of theshort-distance communication may include, but are not limited to, awireless local area network (LAN) (e.g., Wi-Fi), near fieldcommunication (NFC), Bluetooth, Bluetooth Low Energy (BLE), ZigBee,Wi-Fi Direct (WFD), and ultra wideband (UWB). The first device 100 maybe wiredly or wirelessly connected with the management server 300.

The first device 100 may request the second device 200 or the managementserver 300 for a recommendation item and may receive the recommendationitem. In the present exemplary embodiment, the recommendation item maybe related to the content reproduced by the second device 200. Forexample, the recommendation item may include, but is not limited to, anapplication item, a resume item, an additional information item, and anadvertisement item that correspond to the content reproduced by thesecond device 200.

The recommendation item may be configured of an image of the content,and link information or index information each of which is connected tothe image, or may be configured in the form of an object for using aservice.

Throughout the specification, the term ‘object for using a service’indicates a user interface for using a service of a service provider.The object for using a service may be a user interface for using aservice that is provided from a server or the service provider. Forexample, the object for using a service may include the user interfaceincluding an icon, text, an image, and link information, and descriptionrelated to a function of the object.

The first device 100 may receive the object from the server and may usethe service of the service provider by using the object. For example, byusing the object, the first device 100 may obtain content from anapplication program in the first device 100, a data source, server, orcontent provider and may process the content. Also, the object may be auser interface corresponding to a package of services that are providedbased on context information of the user (or the first device 100).

In the present exemplary embodiment, the object may not be installed in,or may not be executed by, the first device 100, but may be analyzed bya host program of the first device 100, so that the object may bedisplayed on a screen of the first device 100 and may be used by theuser. The object may be a gadget but an example of the object is notlimited thereto.

When the first device 100 exits the service zone of the second device200, the first device 100 may display, on a screen, the recommendationitem related to the content reproduced by the second device 200.

In the first device 100, a seamless sensing platform (SSP) may operate,separately from an application processor (AP). The first device 100 mayconnect sensors to a sensor hub of the SSP, and therefore may collect aplurality of pieces of sensing information and may recognize a status,without waking up the AP in a sleep mode. When a predeterminedcircumstance occurs, the sensor hub (e.g., an MCU) of the SSP wakes upthe AP in the sleep mode. Each of the SSP and the AP may be implementedas hardware, software, or combination of hardware and software. The SSPwill be described in detail with reference to FIG. 17.

The second device 200 may be a display device that reproduces content.In particular, the second device 200 may be a public device. Throughoutthe specification, the second device 200 may indicate, but is notlimited to, a display device and a kiosk (e.g., a digital informationdisplay (DID) device or a large format display (LFD) device) that areavailable in public transportation (e.g., a bus, an airplane, a subwaytrain, a commuter train, or the like), a movie screen device installedin a theater, and an electric signboard used in a sports complex.

The second device 200 may be connected with the first device 100 via theshort-distance communication. Also, the second device 200 may performwired or wireless communication with the management server 300.

The second device 200 may transmit, to the first device 100 or themanagement server 300, information about reproduced content (e.g.,identification (ID), information of the content, reproduction positioninformation of the content, a captured image of the content, applicationinformation corresponding to the content, or the like. In anotherexemplary embodiment, the second device 200 may generate arecommendation item related to the reproduced content and then maytransmit the recommendation item to the first device 100 or themanagement server 300.

The management server 300 may manage at least one second device 200 thatprovides the content reproduction service, and may provide to the firstdevice 100 the recommendation item related to the content reproduced bythe second device 200.

The management server 300 may perform communication with the firstdevice 100 or the second device 200. For example, when the managementserver 300 receives, from the first device 100, a request for therecommendation item related to the content reproduced by the seconddevice 200, the management server 300 may request the second device 200for the information related to the content. Then, the management server300 may generate the recommendation item based on the informationrelated to the content which is received from the second device 200, andmay transmit the recommendation item to the first device 100.

The management server 300 may include an intelligence engine that mayanalyze a plurality of pieces of event information that are collected bythe first device 100. For example, the management server 300 may analyzeevent information and therefore may calculate an interest level of theuser of the first device 100 on the content reproduced by the seconddevice 200, a probability that the user of the first device 100 mightview the content reproduced by the second device 200, or the like.

Hereinafter, a method of providing a recommendation item to a user viacommunication among the first device 100, the second device 200, and themanagement server 300 will be described in detail with reference toFIGS. 2 through 5.

FIG. 2 is a flowchart of a method of displaying a recommendation item,the method performed by the first device 100, according to an exemplaryembodiment.

In operation S210, the first device 100 may sense an exit of the firstdevice 100 from a service zone of the second device 200 that reproducescontent. For example, in a case where a position of the first device 100exits the service zone of the second device 200 because a user of thefirst device 100 moves to another location while the user carries thefirst device 100, the first device 100 may sense the exit from theservice zone.

In the present exemplary embodiment, the service zone of the seconddevice 200 may include a communication area where the first device 100is able to communicate with the second device 200, a viewing area wherethe user of the first device 100 may directly view the contentreproduced by the second device 200, or the like. In a case where thesecond device 200 is an advertisement panel that reproduces content in abus, the service zone of the second device 200 may be an internal areaof the bus where the user may view the content reproduced by theadvertisement panel, or a communication area of the advertisement panelwhere the advertisement panel is able to communicate with anotherdevice.

When the communication with the second device 200 is discontinued, thefirst device 100 may sense the exit of the first device from the servicezone of the second device 200. Here, the service zone of the seconddevice 200 may be a communication range of the second device.

The first device 100 may be connected to an access point in the servicezone of the second device 200. Here, when the user moves while carryingthe first device 100, the first device 100 may sense that connectionwith the access point in the service zone of the second device 200 isdisconnected.

In another exemplary embodiment, when the first device 100 recognizes anexternal device located outside, or at a boundary of the service zone ofthe second device 200, the first device 100 may sense the exit of thefirst device 100 from the service zone of the second device 200. Forexample, when the first device 100 receives via short-distancecommunication ID information of the external device or positioninformation of the external device from the external device that islocated outside the service zone of the second device 200, the firstdevice 100 may sense the exit of the first device from the service zoneof the second device 200, based on the ID information or the positioninformation of the external device.

In the present exemplary embodiment, the external device may include,but is not limited to, a Near Field Communication (NFC) tag, a ZigBeetag, and a Bluetooth Low Energy (BLE) tag.

For example, the first device 100 may be a portable terminal of a user,the second device 200 may be a display device used in a bus, and theexternal device may be an NFC terminal which senses when the user of thefirst device is getting off the bus. Here, when the user scans theportable terminal on the NFC terminal when disembarking the bus, (thatis the external device located at a boundary of a service zone of thedisplay device), the portable terminal may recognize the NFCdisembarking terminal and therefore may sense an exit of the portableterminal from the service zone of the display device in the bus.

When the first device 100 previously stores information about theservice zone of the second device 200, the first device 100 may sensethe exit of the first device 100 from the service zone of the seconddevice 200, by using current position information. Here, the firstdevice 100 may obtain the current position information by using at leastone of a beacon signal-based technique using radio frequency (RF) or aninfrared ray, an ultrasound-based position recognition technique, aposition recognition technique using a fingerprint of a Wi-Fi signal, aZigBee-based position recognition technique, and a global positioningsystem (GPS) signal-based technique.

For example, the first device 100 may sense how far (e.g., about N km)the first device 100 is from the service zone of the second device 200,by using information of Wi-Fi, GPS, a communication network basestation, etc.

In the present exemplary embodiment, when the user of the first deviceperforms a check-in operation in the service zone of the second device200, the first device 100 may estimate a movement distance to which thefirst device 100 moves from a position of the check-in, by using anacceleration sensor. In the present exemplary embodiment, the check-inmay mean an action in which a user intentionally leaves records aboutvisiting a specific area or using a specific service.

In operation S220, the first device 100 may request the managementserver 300 for a recommendation item related to content reproduced bythe second device 200. That is, when the first device 100 exits theservice zone of the second device 200, the first device 100 may requestthe management server 300 for the recommendation item so as to recommendan item related to content reproduced by the second device 200 to theuser of the first device 100.

The first device 100 may request the management server 300 for therecommendation item while the first device 100 transmits to themanagement server 300 information about the second device 200 andinformation about the service zone of the second device 200.

For example, the first device 100 may request the management server 300for the recommendation item while the first device 100 transmits to themanagement server 300 at least one of position information of the firstdevice 100, position information of the second device 200, and IDinformation of the second device 200. The position information of thefirst device 100 may include the information about the service zone ofthe second device 200 (e.g., an ID value for identifying the servicezone).

The first device 100 may receive information about the management server300 which is broadcast from the second device 200. The information aboutthe management server 300 may include link information (e.g., auniversal resource locator (URL)) for accessing the management server300.

That is, the second device 200 may periodically broadcast theinformation about the management server 300 via short-distancecommunication, wherein the management server 300 may obtain therecommendation item related to the content reproduced by the seconddevice 200. The short-distance communication may include, but is notlimited to, BLE, NFC, UWB, and ANT+. Also, the second device 200 mayprovide the information about the management server 300 capable ofobtaining the recommendation item related to the content reproduced bythe second device 200, via a two-dimensional (2D) barcode (e.g., a QRbarcode), a color code, a gray code, a touch code, etc. When the firstdevice 100 exits the service zone of the second device 200, the firstdevice 100 may request the management server 300 for the recommendationitem, based on the information about the management server 300 which isreceived from the second device 200.

The management server 300 may define the second device 200 or theservice zone of the second device 200, based on at least one of theposition information of the first device 100, the position informationof the second device 200, and the ID information of the second device200. For example, when the first device 100 transmits to the managementserver 300 position information of the first device 100 at a point oftime of the exit of the first device from the service zone of the seconddevice, the management server 300 may define the second device 200 orthe service zone of the second device 200 located within a range of thefirst device 100.

The management server 300 may request the second device 200 forinformation about the content reproduced by the second device 200, andmay generate the recommendation item by using the information about thecontent which is received from the second device 200.

The management server 300 may transmit to the second device 200information about a point of time when the management server 300receives request information about the recommendation item from thefirst device 100. That is, the management server 300 may request thesecond device 200 for information about the content reproduced by thesecond device 200 at the point of time when the management server 300receives the request information about the recommendation item from thefirst device 100.

A difference between the point of time when the management server 300receives the request information about the recommendation item and thepoint of time when the first device 100 exits the service zone of thesecond device 200 may not be great. Thus, in the present exemplaryembodiment, the point of time when the first device 100 exits theservice zone of the second device 200 may correspond to a point of timewhen the management server 300 or the second device 200 receives arequest for the recommendation item.

When the first device 100 periodically receives from the second device200 at least one of reproduction position information (e.g., a timestamp, an index, etc.) of content that is reproduced by the seconddevice 200 and link information of the content, the first device 100 mayrequest the management server 300 for the recommendation item while thefirst device 100 transmits at least one of the reproduction positioninformation of the content and the link information of the content tothe management server 300.

The management server 300 may generate a recommendation item related tothe content reproduced by the second device 200, by using thereproduction position information of the content or the link informationof the content which is received from the first device 100.

In another exemplary embodiment, the management server 300 may requestthe second device 200 for the recommendation item related to the contentreproduced by the second device 200, and may receive the recommendationitem from the second device 200.

In the present exemplary embodiment, when the first device 100 senses agesture of the user of the first device 100 that requests therecommendation item, the first device 100 may request the managementserver 300 for the recommendation item related to the content which isprovided from the second device 200. The gesture of the user which isrelated to requesting the recommendation item may vary. For example, agesture in which a specific button (a home button, a power button, etc.)is pressed over a predetermined time period, a gesture in which aspecific area of a screen is touched, or the like.

When the gesture of the user which requests the recommendation item issensed, although the device 100 is located in the service zone of thesecond device 200, the first device may request the management server300 for the recommendation item.

In operation S230, the first device 100 may receive the recommendationitem related to the content from the management server 300. In thepresent exemplary embodiment, the first device 100 may receive therecommendation item related to the content from the management server300. Here, in the present exemplary embodiment, the first device 100 mayreceive the recommendation item that is generated by the managementserver 300. In another exemplary embodiment, the first device 100 mayreceive from the management server 300 a recommendation item that isgenerated by the second device 200.

In the present exemplary embodiment, the recommendation item mayinclude, but is not limited to, an application item, a resume item, anadditional information item, and an advertisement item that correspondto the content.

The application item may be an item related to an application whichaccesses a content provider that provides the content reproduced by thesecond device 200.

The resume item may be an item for allowing the content that wasreproduced by the second device 200 to be reproduced by the first device100 after the point of time when the first device 100 exits the servicezone of the second device 200.

The additional information item may be an item for providing a pluralityof pieces of additional information (e.g., in a case of movie content,an introduction of cast and crew, a synopsis, grades, a preview,original soundtrack (OST) information, etc.) related to the contentreproduced by the second device 200. The advertisement item may be anitem for inducing the user to purchase the content or an additionalservice related to the content.

In operation S240, the first device 100 may display the recommendationitem related to the content on a screen of the first device 100.

The screen of the first device 100 may include, but is not limited to, afirst screen that is first displayed on the first device 100 when anoperation mode of the first device 100 is switched from a standby modeto an active mode (e.g., when the first device 100 is unlocked, power ofthe first device 100 is on, or the like). For example, the first device100 may display the recommendation item on a specific page of aplurality of pages having icons arrayed thereon, or may display therecommendation item on a predetermined area of a background screen.

When the recommendation item includes a plurality of recommendationitems, the first device 100 may display a list of the recommendationitems on the screen.

The recommendation item displayed on the first device 100 may beconfigured of an image of the content, and link information or indexinformation each of which is connected to the image. For example, therecommendation item may be formed in a manner that a captured image ofthe content reproduced by the second device 200 at the point of timewhen the first device 100 exits the service zone of the second device200 (hereinafter, a ‘last screen image’) is connected with reproductionposition information indicating a reproduction position of the contentat the point of time when the first device 100 exits the service zone ofthe second device.

The reproduction position information may include link information(e.g., a URL) for accessing the content reproduced by the second device200 at the point of time when the first device 100 exits the servicezone of the second device, index information (e.g., a uniform resourceidentifier (URI)) for accessing still image content displayed by thesecond device 200 at the point of time when the first device 100 exitsthe service zone of the second device, or the like.

In another exemplary embodiment, the recommendation item may beconfigured of a text indicating the content and the reproductionposition information that is connected to the text. The text may beprovided by a content provider.

In the present exemplary embodiment, the management server 300 maytransmit the recommendation item related to the content to a cloudserver that is connected to the first device 100. In this case, whenrequired, the first device 100 may receive the recommendation item fromthe cloud server and may display the recommendation item on the screen.

When the first device 100 exits the service zone of the second device200, the user of the first device 100 may no longer view the contentreproduced by the second device 200, so that the first device 100displays the recommendation item on the screen so as to recommend, tothe user, information related to the content reproduced by the seconddevice 200. This is described in detail with reference to FIG. 3.

FIG. 3 illustrates a method of displaying a recommendation item, themethod performed by the first device 100, according to another exemplaryembodiment. In the exemplary embodiment of FIG. 3, it is assumed thatthe first device 100 is a personal mobile device and the second device200 is a public device.

An ‘A’ public device 200-1 may reproduce animation content (operation1). Here, a user of the first device 100 in a service zone of the ‘A’public device 200-1 may view the animation content reproduced by the ‘A’public device 200-1. When the user of the first device 100 stays in theservice zone of the ‘A’ public device 200-1 over a predetermined timeperiod and then exits the service zone, the user of the first device 100may no longer view the animation content reproduced by the ‘A’ publicdevice 200-1.

Thus, when the first device 100 senses the exit of the first device 100from the service zone of the ‘A’ public device 200-1 (operation 2), thefirst device 100 may request the management server 300 for arecommendation item related to the animation content reproduced by the‘A’ public device 200-1 (operation 3). The operation 2, in which thefirst device 100 senses the exit from the service zone of the ‘A’ publicdevice 200-1, corresponds to operation S210 of the exemplary embodimentshown FIG. 2, and thus, the detailed descriptions thereof are omittedhere.

The management server 300 may have a database about service zones of thesecond device 200. Thus, when the management server 300 receives arequest for the recommendation item from the first device 100, themanagement server 300 may define the ‘A’ public device 200-1 as thesecond device 200, based on a position of the first device 100.

The management server 300 may request the ‘A’ public device 200-1 forinformation about the animation content reproduced by the ‘A’ publicdevice 200-1 at a point of time when the first device 100 exits theservice zone of the ‘A’ public device 200-1 (or when the managementserver 300 receives the request for the recommendation item from thefirst device 100). Here, in response to the request from the managementserver 300, the ‘A’ public device 200-1 may transmit to the managementserver 300 at least one of an image of the animation content reproducedby the ‘A’ public device 200-1 at the point of time when the firstdevice 100 exits the service zone of the ‘A’ public device 200-1 (orwhen the management server 300 receives the request for therecommendation item from the first device 100), reproduction positioninformation (e.g., link information or index information) of the contentreproduced by the ‘A’ public device 200-1 at the point of time when thefirst device 100 exits the service zone of the ‘A’ public device 200-1(or when the management server 300 receives the request for therecommendation item from the first device 100), application informationcorresponding to the content reproduced by the ‘A’ public device 200-1at the point of time when the first device 100 exits the service zone ofthe ‘A’ public device 200-1 (or when the management server 300 receivesthe request for the recommendation item from the first device 100),additional information, and advertisement information related to contentreproduced by the ‘A’ public device 200-1 at the point of time when thefirst device 100 exits the service zone of the ‘A’ public device 200-1(or when the management server 300 receives the request for therecommendation item from the first device 100) (operation 4).

The ‘A’ public device 200-1 may transmit to the management server 300 acaptured image (i.e., a last screen image) of a screen reproducing thecontent at the point of time when the first device 100 exits the servicezone of the ‘A’ public device 200-1 (or when the management server 300receives the request for the recommendation item from the first device100).

The management server 300 may generate the recommendation item by usinga plurality of pieces of information received from the ‘A’ public device200-1 (operation 5). For example, the management server 300 may generatea resume item as the recommendation item by using information receivedfrom the ‘A’ public device 200-1, i.e., by using the captured image(i.e., the last screen image) and the reproduction position informationof the content that is reproduced at the point of time when the firstdevice 100 exits the service zone of the ‘A’ public device 200-1. Also,the management server 300 may generate an additional information item byusing the additional information received from the ‘A’ public device200-1, or may generate an application item by using the applicationinformation received from the ‘A’ public device 200-1. Here, themanagement server 300 may generate the recommendation item in the formof an object (e.g., a gadget) for using a service, or in the form of alist.

The management server 300 may provide the recommendation item to thefirst device 100 (operation 6). The first device 100 may display therecommendation item received from the management server 300 on a screen(e.g., a first screen) (operation 7).

Thus, according to the present exemplary embodiment, when the user ofthe first device 100 views content reproduced by a public device andthen exits a service zone of the public device, the first device 100 mayprovide to the user a recommendation item (e.g., a resume item) relatedto the content reproduced by the public device, so that, although theuser exits the service zone of the public device, the user maycontinuously use a service provided by the public device.

Hereinafter, when the first device 100 performs a context analysis andrecognizes that the user of the first device 100 has a high interestlevel with regard to content reproduced by the second device 200, amethod of displaying a recommendation item on a screen of the firstdevice 100, the method performed by the first device 100, will now bedescribed.

FIG. 4 is a flowchart of a method of displaying a recommendation itemafter the first device 100 performs a context analysis, the methodperformed by the first device 100, according to an exemplary embodiment.

In operation S405, the second device 200 may reproduce content. Thecontent may include, but is not limited to, education content, moviecontent, broadcasting content, game content, advertisement content,still image content, and news content.

In operation S410, the first device 100 may collect event informationabout an event that occurs in the first device 100. That is, the firstdevice 100 may sense various types of events occurring in the firstdevice 100 and may collect a plurality of pieces of event informationabout the various types of sensed events.

For example, the first device 100 may collect position information, ornetwork information (e.g., a GPS-coordinates information, cell-IDinformation, Wi-Fi access point information, or the like) which is ofthe first device 100.

Also, the first device 100 may collect state information about a stateof a user of the first device 100. The state information of the user mayindicate movement, a life pattern, etc. of the user, and may include aplurality of pieces of information about a walking state, an exercisingstate, a driving state, a sleeping state, etc. of the user. For example,when the user connects the first device 100 to a stand in a house, thefirst device 100 may determine that the user is in a sleeping state, inconsideration of position information, tilt information, movementinformation, current time information, alarm setting information, etc.of the first device 100 Also, when the user connects the first device100 to a stand in a car, the first device 100 may determine that theuser is in the driving state, in consideration of position information,tilt information, movement information, etc. of the first device 100.

The first device 100 may collect contents that are input via a userinput device. For example, the first device 100 may collect a pluralityof pieces of information about texts, drawings, symbols, etc. that areinput by a user via a touch screen, or may recognize a voice of the userand may collect vocal contents input by the user.

The first device 100 may collect exchanged message information,exchanged email information, call history information, social networkservice (SNS) use information, and webpage use information. For example,the first device 100 may collect transmission and reception times ofmessages or emails, contents included in exchanged messages or emails,call contents, a call time, caller or receiver information, an SNSserver access time, an SNS use history, information received from an SNSserver, a webpage access time, a webpage use history, or the like.

The first device 100 may collect a plurality of pieces of useinformation regarding applications in the first device 100. For example,when the user executes and uses a housekeeping book application, thefirst device 100 may collect a plurality of pieces of use informationabout expenses, incomes, investments, etc., that are recorded to ahousekeeping book, or when the user executes a schedule managementapplication and inputs a schedule, the first device 100 may collectschedule information of the user. Also, when the user executes a captureapplication and captures content, the first device 100 may collectcontent information about the captured content, or when the userexecutes a music reproduction application and reproduces music, thefirst device 100 may collect music information about the musicreproduced by the user.

The first device 100 may collect ID information, type information, usetime information, use period information, etc. about applications thatthe user installed, uses, or searches for. Also, when the user performsa transaction by using a mobile card in the first device 100, the firstdevice 100 may collect transaction information, purchase patterninformation, etc., about the user.

That is, the first device 100 may collect via various sensors theplurality of pieces of event information about the events occurring inthe first device 100, a plurality of pieces of information about theuser of the first device 100, or the like. Here, the first device 100may periodically collect the plurality of pieces of event information ormay collect event information in real-time when a specific event occurs.

The first device 100 may collect the plurality of pieces of eventinformation via an SSP, and therefore may significantly decrease powerconsumption for collecting the plurality of pieces of event information.

In operation S415, the first device 100 may sense an exit of the firstdevice 100 from a service zone of the second device 200. The firstdevice 100 may sense the exit from the service zone of the second device200 by using the plurality of pieces of event information.

For example, when communication connection with the second device 200 isdiscontinued, the first device 100 may sense the exit of the firstdevice from the service zone of the second device 200.

Also, when the first device 100 recognizes an external device (e.g., anNFC tag, a BLE tag, etc.) located outside of the service zone of thesecond device 200, or at a boundary of the service zone of the seconddevice 200, the first device 100 may sense the exit of the first devicefrom the service zone of the second device 200.

When the first device 100 previously stores information about theservice zone of the second device 200, the first device 100 may sensethe exit of the first device from the service zone of the second device200, by using current position information. Operation S415 correspondsto operation S210, thus, detailed descriptions thereof are omitted here.

In operation S420, the first device 100 may calculate an interest levelof the user of the first device 100 with regard to the contentreproduced by the second device 200, based on the plurality of pieces ofevent information. The first device 100 may calculate the interest levelof the user of the first device 100 with regard to the contentreproduced by the second device 200, based on input information of theuser, state information of the user, the current position information,reservation history information, etc.

For example, when the user of the first device 100 performs a check-inoperation with respect to the second device 200 or the service zone ofthe second device 200 by using the first device 100, the first device100 may calculate a high interest level of the user of the first device100 for the content reproduced by the second device 200.

The first device 100 may calculate a probability that the user of thefirst device 100 might view the content reproduced by the second device200, and therefore may calculate the interest level of the user of thefirst device 100.

Here, the first device 100 may calculate the probability that the userof the first device 100 might view the content reproduced by the seconddevice 200, based on the state information of the user, the currentposition information, application information about an applicationexecuted in the first device 100, or the like.

For example, when the user of the first device 100 downloads to thefirst device 100 data that is provided by the second device 200, orinputs recommendation information to the first device 100 so as torecommend the content reproduced by the second device 200 to anotheruser via an SNS, the first device 100 may calculate a high probability(e.g., about 95%) that the user of the first device 100 might view thecontent reproduced by the second device 200.

Also, when the user of the first device 100 stays in the service zone ofthe second device 100 over a predetermined time period and, while theuser of the first device 100 stays in the service zone, if the user ofthe first device 100 manipulates the first device 100 by a number oftimes or for a time period that are less than a predetermined referencevalue, the probability that the user of the first device 100 might viewthe content reproduced by the second device 200 may be high.

That is, when a position of the first device 100 is not changed in theservice zone of the second device 100 over the predetermined timeperiod, and the first device 100 does not sense an input of the userover a predetermined time period, the first device 100 may calculate ahigh probability (e.g., about 90%) that the user of the first device 100might wish to view the content reproduced by the second device 200.

Although the first device 100 is positioned in the service zone of thesecond device 100 over the predetermined time period, while the firstdevice 100 is positioned in the service zone of the second device 100,if the first device 100 receives from the user of the first device 100an execution request with respect to an application that is irrelevantto the content reproduced by the second device 200, the first device 100may calculate a low probability (e.g., about 30%) that the user of thefirst device 100 might wish to view the content reproduced by the seconddevice 200. Here, the second device 200 may broadcast information aboutthe content reproduced by the second device 200.

In the present exemplary embodiment, the first device 100 may sense theuser's eyes via a camera and therefore may calculate a probability thatthe user of the first device 100 might view the content reproduced bythe second device 200.

For example, as a result of sensing the user's eyes, if the user keepsstaring at a screen of the first device 100, the first device 100 maycalculate a low probability (e.g., about 10%) that the user of the firstdevice 100 might view the content reproduced by the second device 200.On the other hand, as the result of sensing the user's eyes, if the userdoes not stare at the screen of the first device 100, the first device100 may calculate a probability of at least 70% that the user of thefirst device 100 might view the content reproduced by the second device200.

In a case where the user of the first device 100 purchased a movieticket by using the first device 100, and the first device 100 ispositioned in a theater at a time when a movie corresponding to themovie ticket is shown, the first device 100 may calculate a highprobability (e.g., about 98%) that the user of the first device 100might view the movie reproduced by the second device 200 (e.g., a moviescreening apparatus).

For example, in a case where the user booked a movie ticket of aparticular movie to be shown in a particular theater at 5 p.m. on Mar.1, 2013, by using the first device 100, or the user downloaded thepurchased movie ticket from a server, the first device 100 may collectand analyze information regarding an event related to the purchasing ofthe movie ticket. Then, when the first device exits the particulartheater at 6:30 p.m. on Mar. 1, 2013, the first device 100 may calculatea high probability (e.g., about 99.9%) that the user of the first device100 views the particular movie. According to the present exemplaryembodiment, the first device 100 may analyze event information collectedbased on ontology, and thus may obtain information about an interestlevel of the user of the first device 100 with regard to the contentreproduced by the second device 200.

Ontology means formal and explicit specification about sharedconceptualization. Ontology may mean a type of dictionary consisting ofwords and relations therebetween, in which words related to a specificdomain are hierarchically expressed and a logical rule for an additionalextension exists therein.

In the present exemplary embodiment, the first device 100 may analyze atext or voice which is input from the user, based on ontology. That is,the first device 100 may obtain information about correlation betweenthe text/voice input from the user and the content reproduced by thesecond device 200, based on ontology. Here, the second device 200 maybroadcast information about the content reproduced by the second device200. Based on the information about the correlation between thetext/voice input from the user and the content reproduced by the seconddevice 200, the first device 100 may calculate the interest level of theuser of the first device 100 with regard to the content reproduced bythe second device 200.

For example, the second device 200 may show an particular animation andthe first device 100 may receive information (e.g., a content type, acontent title, a reproduction position of content, scene information,etc.) about the particular animation from the second device 200. Here,the first device 100 may extract keywords after analyzing a voice of theuser which is obtained via a microphone, and may calculate a correlationbetween the extracted keywords and a plurality of pieces of informationabout the particular animation that are received from the second device200, based on ontology.

If the user of the first device 100 frequently mentions words related tothe particular animation while the user talks with a friend directly oron a telephone call, the first device 100 may determine that the userhas a high interest level in the particular animation reproduced by thesecond device 200.

In operation S425, the first device 100 may determine whether theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than apredetermined value (e.g., whether a probability that the user of thefirst device 100 might view the content reproduced by the second device200 is equal to or greater than 85%). The predetermined value may be setin the first device 100, may be set by the user, or may be set by themanagement server 300.

In the present exemplary embodiment, the first device 100 in apredetermined context may estimate, without calculating the interestlevel, that the interest level of the user of the first device 100 inthe content reproduced by the second device 200 is equal to or greaterthan the predetermined value.

For example, when the first device 100 has a purchase history of a viewticket with respect to the content reproduced by the second device 200,or has a check-in history with respect to the service zone of the seconddevice 200, the first device 100 may determine that the interest levelof the user of the first device 100 on the content reproduced by thesecond device 200 is equal to or greater than the predetermined value.

That is, when the user of the first device 100 intentionally purchasedthe ticket to view particular content, the first device 100 may analyzethat the interest level of the user of the first device 100 on thecontent reproduced by the second device 200 is high. Thus, the firstdevice 100 may not particularly calculate the probability that the userof the first device 100 might view the content reproduced by the seconddevice 200.

In operation S430, when the interest level of the user of the firstdevice 100 in the content reproduced by the second device 200 is equalto or greater than the predetermined value, the first device 100 mayrequest the management server 300 for a recommendation item related tothe content reproduced by the second device 200. For example, when theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than 85%, thefirst device 100 may request the management server 300 for therecommendation item.

The first device 100 may request the recommendation item while the firstdevice 100 transmits to the management server 300 at least one ofposition information of the first device 100, position information ofthe second device 200, ID information of the second device 200,reproduction position information of the content, and link informationof the content.

When the interest level of the user of the first device 100 on thecontent reproduced by the second device 200 is less than thepredetermined value, the first device 100 may not request the managementserver 300 for the recommendation item.

In operation S435, in order to generate the recommendation item, themanagement server 300 may request the second device 200 for informationabout the content reproduced by the second device 200 at a point of timewhen the first device 100 exits the service zone.

In operation S440, in response to the request from the management server300, the second device 200 may transmit to the management server 300 theinformation about the content that is reproduced at the point of timewhen the first device 100 exits the service zone.

For example, the second device 200 may capture a screen that reproducesthe content at the point of time when the first device 100 exits theservice zone, and may transmit the captured image (i.e., a last screenimage) to the management server 300. Also, the second device 200 maytransmit to the management server 300 at least one of reproductionposition information (e.g., link information or index information) ofthe content reproduced by the second device 200 at the point of timewhen the first device 100 exits the service zone of the second device200, application information corresponding to the content reproduced bythe second device 200 at the point of time when the first device 100exits the service zone of the second device 200, additional information,and advertisement information related to content reproduced by thesecond device 200 at the point of time when the first device 100 exitsthe service zone of the second device 200.

In operation S445, the management server 300 may generate therecommendation item related to the content. For example, the managementserver 300 may generate a resume item as the recommendation item byusing the captured image (i.e., the last screen image) and thereproduction position information (e.g., the link information or theindex information) that are received from the second device 200. Also,the management server 300 may generate an additional information item byusing the additional information received from the second device 200, ormay generate an application item by using the application informationreceived from the second device 200. Here, the management server 300 maygenerate the recommendation item in the form of an object (e.g., agadget) for using a service, or in the form of a list.

In operation S450, the management server 300 may provide therecommendation item to the first device 100. According to the presentexemplary embodiment, the management server 300 may provide therecommendation item to the first device 100 via wired or wirelesscommunication.

In operation S455, the first device 100 may display the recommendationitem on a screen. Here, the first device 100 may display therecommendation item on the screen, in consideration of contextinformation of the user.

For example, when the first device 100 senses a gesture of the user ofthe first device 100 that requests the recommendation item, the firstdevice 100 may display the recommendation item on the screen. Thegesture of the user which is related to requesting the recommendationitem may vary.

Also, the first device 100 may display the recommendation item on thescreen, based on luminance information, tilt information, etc. Forexample, when a luminance of the first device 100 is less than apredetermined value, the first device 100 may not display therecommendation item on the screen, and when the luminance of the firstdevice 100 is equal to or greater than the predetermined value, thefirst device 100 may display the recommendation item on the screen.

That is, in a case where the user of the first device 100 keeps thefirst device 100 in the user's pocket or does not carry the first device100 in the user's hand, it may mean that the user may not have anintention to receive the recommendation item. Thus, the first device 100may not display the recommendation item on the screen, based on theluminance information or the tilt information.

On the other hand, when the first device 100 exits the service zone ofthe second device 200, if the user of the first device 100 stares at thescreen while the user holds the first device 100 in the user's hand, thefirst device 100 may display on the screen the recommendation itemrelated to the content reproduced by the second device 200.

Thus, according to the present exemplary embodiment, the first device100 considers the context information of the user and therefore, whenthe user does not want the recommendation item or cannot view therecommendation item, the first device 100 may not display therecommendation item on the screen.

The first device 100 may display the recommendation item according to auser-designated setting. For example, the first device 100 may providethe recommendation item in the form of a pop-up window or may displaythe recommendation item on a specific page.

The first device 100 may scan the service zone of the second device 200that the first device 100 previously visited, and the scan may beperformed within a predetermined range with respect to a currentposition. When the service zone of the second device 200 that the firstdevice 100 previously visited is scanned, the first device 100 mayextract a recommendation item related to content that was previouslyreproduced by the second device 200 and may display the recommendationitem on the screen.

For example, in a case where a gallery that the user of the first device100 visited one month ago is located in a building next to a departmentstore where the first device 100 is currently positioned, the firstdevice 100 may extract a recommendation item related to content that theuser viewed in the gallery one month ago and may display therecommendation item on the screen.

That is, according to the present exemplary embodiment, in a case wherea service zone that the user previously visited is located adjacent tothe user, and the user viewed content in the service zone, the firstdevice 100 may provide a recommendation item related to the content thatthe user viewed.

Operation S455 corresponds to operation S240 shown in FIG. 2 and thusrepeated detailed descriptions thereof are omitted here.

According to the present exemplary embodiment, the first device 100 mayperform the context analysis and therefore may provide to the user arecommendation item related to content having a high probability thatthe user might view from among a plurality of pieces of content that arereproduced by a public device. Thus, it is possible to prevent manyunnecessary recommendation items from being provided to the user via thefirst device 100.

In another exemplary embodiment, an order of operations S405 throughS455 may be changed or some operations may be skipped.

FIG. 5 is a flowchart of a method of providing a recommendation item,the method performed by the management server 300, according to anexemplary embodiment.

In operation S505, the second device 200 may reproduce content. Here,the first device 100 may be positioned in a service zone of the seconddevice 200.

In operation S510, the first device 100 may collect event informationabout an event that occurs in the first device 100. That is, the firstdevice 100 may sense various types of events occurring in the firstdevice 100 and may collect a plurality of pieces of event informationabout the various types of sensed events. For example, the first device100 may collect position information, network information, user's stateinformation, exchanged message information, exchanged email information,call history information, SNS use information, application useinformation, and webpage use information, transaction information, etc.of the first device 100.

In operation S515, the first device 100 may transmit the plurality ofpieces of event information to the management server 300. The firstdevice 100 may transmit all or some of the plurality of pieces of eventinformation to the management server 300. For example, the first device100 may not transmit to the management server 300 a plurality of piecesof personal financial information (e.g., a bank account, a credit cardnumber, etc.) that are input by the user.

The first device 100 may periodically transmit the plurality of piecesof event information to the management server 300 or may transmit eventinformation to the management server 300 when a specific event occurs.The first device 100 may encrypt the event information by using apre-agreed encryption code and then may transmit the encrypted eventinformation to the management server 300.

In operation S520, the first device 100 may sense an exit of the firstdevice 100 from the service zone of the second device 200. Here, inoperation S525, the first device 100 may request the management server300 for a recommendation item related to the content reproduced by thesecond device 200. That is, when the first device 100 exits the servicezone of the second device 200 that reproduces the content, themanagement server 300 may receive a request for the recommendation itemfrom the first device 100.

In operation S530, the management server 300 may calculate an interestlevel of the user in the content reproduced by the second device 200.For example, when the user of the first device 100 performs a check-inprocedure with respect to the second device 200 or the service zone ofthe second device 200 by using the first device 100, the managementserver 300 may receive check-in information from the first device 100.Here, the management server 300 may calculate a high interest level ofthe user of the first device 100 in the content reproduced by the seconddevice 200.

The management server 300 may calculate a probability that the user ofthe first device 100 might view the content reproduced by the seconddevice 200, based on the plurality of pieces of event informationcollected by the first device 100, and therefore may calculate theinterest level of the user of the first device 100 in the contentreproduced by the second device 200.

Here, the management server 300 may calculate the probability that theuser of the first device 100 might view the content reproduced by thesecond device 200, based on input information of the user, stateinformation of the user, the current position information, reservationhistory information, etc. that are received from the first device 100.

For example, when the management server 300 receives a plurality ofpieces of event information about events in which the user of the firstdevice 100 downloads to the first device 100 data that is provided bythe second device 200, or inputs recommendation information to the firstdevice 100 so as to recommend the content reproduced by the seconddevice 200 to another user, then the management server 300 may calculatea high probability (e.g., about 95%) that the user of the first device100 might view the content reproduced by the second device 200.

Also, when a position of the first device 100 is not changed in theservice zone of the second device 200 over the predetermined timeperiod, and an input of the user is not sensed over a predetermined timeperiod, the management server 300 may calculate a high probability(e.g., about 90%) that the user of the first device 100 might view thecontent reproduced by the second device 200.

Although the first device 100 is positioned in the service zone of thesecond device 200 during the predetermined time period, while the firstdevice 100 is positioned in the service zone of the second device 200,if the user of the first device 100 performs, by using the first device100, an operation that is irrelevant to the content reproduced by thesecond device 200, the management server 300 may calculate a lowprobability (e.g., about 30%) that the user of the first device 100might view the content reproduced by the second device 200.

In a case where the user of the first device 100 purchased a movieticket by using the first device 100, and the first device 100 ispositioned in a theater at a time when a movie corresponding to thepurchased movie ticket is shown, the management server 300 may calculatea high probability (e.g., about 98%) that the user of the first device100 might view the movie reproduced by the second device 200 (e.g., amovie screening apparatus).

In the present exemplary embodiment, the management server 300 maycalculate a probability that the user of the first device 100 might viewthe content reproduced by the second device 200, based on informationthat is obtained by the first device 100 by sensing the user's eyes viaa camera.

According to the present exemplary embodiment, the management server 300may analyze event information collected by the first device 100 based onontology, and thus may obtain information about an interest level of theuser of the first device 100 on the content reproduced by the seconddevice 200.

For example, the management server 300 may obtain information about acorrelation between text/voice inputs by the user and the contentreproduced by the second device 200, based on ontology. Based on theinformation about the correlation between the text/voice inputs by theuser and the content reproduced by the second device 200, the managementserver 300 may calculate the interest level of the user of the firstdevice 100 on the content reproduced by the second device 200.

In operation S535, the management server 300 may determine whether theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than apredetermined value (e.g., whether a probability that the user of thefirst device 100 might view the content reproduced by the second device200 is equal to or greater than 85%). The predetermined value may be setby the user or by the management server 300.

In the present exemplary embodiment, the management server 300 in apredetermined context may estimate (or may determine), withoutcalculating the interest level, that the interest level of the user ofthe first device 100 in the content reproduced by the second device 200is equal to or greater than the predetermined value.

For example, when the user of the first device 100 has a history ofpurchasing a ticket to view the content reproduced by the second device200, or has a check-in history with respect to the service zone of thesecond device 200, the management server 300 may determine that theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than thepredetermined value.

In operation S540, when the interest level of the user of the firstdevice 100 in the content reproduced by the second device 200 is equalto or greater than the predetermined value, the management server 300may request the second device 200 for information about the contentreproduced by the second device 200. Here, the management server 300 maytransmit to the second device 200 information about a point of time whenthe first device 100 exits the service zone of the second device 200.

In operation S545, the management server 300 may receive the informationabout the content from the second device 200. For example, themanagement server 300 may receive from the second device 200 at leastone of captured image information obtained by capturing an image of thecontent reproduced by the second device 200 at the point of time whenthe first device 100 exits the service zone of the second device 200,reproduction position information of the content reproduced by thesecond device 200 at the point of time when the first device 100 exitsthe service zone of the second device 200, application informationcorresponding to the content, additional information about the content,and advertisement information corresponding to the content.

In operation S550, the management server 300 may generate arecommendation item related to the content reproduced by the seconddevice 200 at the point of time when the first device 100 exits theservice zone of the second device 200, based on the information aboutthe content which is received from the second device 200.

For example, the management server 300 may generate a resume item byusing the captured image information obtained by capturing the image ofthe content reproduced by the second device 200 at the point of timewhen the first device 100 exits the service zone of the second device,and the reproduction position information (e.g., a time stamp, indexinformation, etc.) about the content reproduced by the second device 200at the point of time when the first device 100 exits the service zone ofthe second device.

In operation S555, the management server 300 may transmit the generatedrecommendation item to the first device 100. Here, in the presentexemplary embodiment, the first device 100 may store the recommendationitem in its memory.

In operation S560, the first device 100 may sense a gesture of the userof the first device 100 that requests the recommendation item. Forexample, the first device 100 may sense the gesture in which the userpresses a specific button (e.g., a home button), touches a specific areaof a screen, unlocks a lock of the device, or the like.

In operation S565, when the first device 100 senses the gesture of theuser who requests the recommendation item, the first device 100 maydisplay on the screen the recommendation item that is received from themanagement server 300. The screen may be a first screen.

In another exemplary embodiment, an order of operations S505 throughS565 may be changed or some operations may be skipped. For example, inother exemplary embodiments, operations S530 and S535 may be performedafter operation S545 or after operation S550.

Hereinafter, a method of receiving a recommendation item from the seconddevice 200 without using the management server 300 and displaying therecommendation item on a predetermined screen, the method performed bythe first device 100, will be described in detail with reference toFIGS. 6 through 8.

FIG. 6 is a flowchart of a method of displaying a recommendation item,the method performed by the first device 100, according to anotherexemplary embodiment.

In operation S610, the second device 200 may reproduce content. Here,the first device 100 may be positioned in a service zone 600 of thesecond device 200. In the present exemplary embodiment, the service zone600 includes a communication area where the first device 100 is able tocommunicate with the second device 200, or a viewing area where the userof the first device 100 may directly view the content reproduced by thesecond device 200.

In operation S620, the first device 100 may request the second device200 for a recommendation item related to the content reproduced by thesecond device 200. Here, the first device 100 may request the seconddevice 200 for the recommendation item, provided that the first device100 is positioned in the service zone 600 of the second device 200 for apredetermined time period (e.g., 5 minutes).

For example, when the first device 100 receives via short-distancecommunication a signal that is broadcast from the second device 200 overa predetermined time period, the first device 100 may request the seconddevice 200 for the recommendation item related to the content reproducedby the second device 200. Additionally, when the first device 100recognizes an NFC terminal which senses the first device, and allows auser of the first device to board a bus, and then a predetermined timeperiod (e.g., 3 minutes) elapses, the first device 100 may request thesecond device 200 for a recommendation item related to contentreproduced by the second device 200, which may be a display deviceinstalled in the bus.

In operation S630, the second device 200 may generate the recommendationitem related to the content reproduced by the second device 200. In thepresent exemplary embodiment, the second device 200 may generate therecommendation item in real-time at a point of time when the seconddevice 200 receives a request for the recommendation item from the firstdevice. For example, the second device 200 may capture a screen thatreproduces the content at the point of time when the second device 200receives the request. Then, the second device 200 may generate a resumeitem by linking the captured image to reproduction position informationindicating a reproduction position of the content that is reproducedwhile captured.

Before the second device 200 receives the request for the recommendationitem from the first device 100, the second device 200 may previouslygenerate the recommendation item related to the reproduced content. Inthis case, when the second device 200 receives the request for therecommendation item from the first device 100, the second device 200 mayextract the recommendation item related to the reproduced content fromits memory.

In operation S640, the second device 200 may provide to the first device100 the recommendation item related to the reproduced content. Forexample, the second device 200 may transmit at least one of the resumeitem, an application item, an additional information item, and anadvertisement item to the first device 100 via short-distancecommunication.

After the second device 200 transmits the recommendation item, if therecommendation item is subsequently updated, the second device 200 maytransmit the updated recommendation item to the first device 100. In acase of the resume item, because the reproduction position of thecontent is changed according to an elapse of time, the second device 200may update the resume item according to a changed reproduction positionof the content and may transmit the updated resume item to the firstdevice 100. When the second device 200 receives the request for therecommendation item from the first device 100, the second device 200 mayperiodically transmit the recommendation item.

The first device 100 may receive from the second device 200 therecommendation item related to the content reproduced by the seconddevice 200.

In operation S650, the first device 100 may store in its memory therecommendation item received from the second device 200. Here, becausethe first device 100 is positioned in the service zone 600 of the seconddevice 200, the first device 100 may only store in the memory therecommendation item received from the second device 200, and may notdisplay the recommendation item on a screen.

In operation S660, the first device 100 may sense an exit of the firstdevice 100 from the service zone 600 of the second device 200. In thiscase, in operation S670, the first device 100 may display therecommendation item on the screen.

That is, while the first device 100 is positioned in the service zone600 of the second device 200, the first device 100 may not display onthe screen the recommendation item received from the second device 200,and then, when the first device 100 exits the service zone 600 of thesecond device 200, the first device 100 may display on the screen therecommendation item related to the content reproduced by the seconddevice 200. In another exemplary embodiment, an order of operations S610through S670 may be changed or some operations may be skipped. Forexample, in a case where the second device 200 periodically broadcaststhe recommendation item, an operation of requesting by the first device100 the second device 200 for the recommendation item may not berequired.

With reference to FIG. 7, a method of providing a recommendation itemwithout using the management server 300, the method performed by thefirst device 100 and the second device 200, will now be described.

FIG. 7 is a flowchart of a method of displaying a recommendation item,the method performed by the first device 100, according to anotherexemplary embodiment.

In operation S710, the first device 100 and the second device 200 may beable to communicate with each other. For example, the first device 100and the second device 200 may be connected to each other via ashort-distance communication network such as Wi-Fi, Bluetooth, NFC,ZigBee, WFD, UWB, etc.

In operation S720, the second device 200 may reproduce content. In thepresent exemplary embodiment, the content may include, but is notlimited to, education content, movie content, broadcasting content, gamecontent, advertisement content, still image content, and news content.

In another exemplary embodiment, an order of operations S710 and S720may be changed. That is, the second device 200 may reproduce the contentwhile the second device 200 is connected with the first device 100 via acommunication network, or the second device 200 may be connected withthe first device 100 via the communication network after the seconddevice 200 reproduces the content.

In operation S730, the first device 100 may calculate an interest levelof a user of the first device 100 in the content reproduced by thesecond device 200, based on a plurality of pieces of event information.For example, the first device 100 may calculate a probability that theuser of the first device 100 might view the content reproduced by thesecond device 200, based on input information of the user, stateinformation of the user, the current position information, reservationhistory information, etc, and therefore may calculate the interest levelof the user of the first device 100 on the content reproduced by thesecond device 200. Because operation S730 corresponds to operation S420shown in FIG. 4, the detailed descriptions thereof are omitted here.

In operation S740, the first device 100 may determine whether theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than apredetermined value (e.g., whether a probability that the user of thefirst device 100 might view the content reproduced by the second device200 is equal to or greater than 85%). The predetermined value may be setin the first device 100 or may be set by the user.

Because operation S740 corresponds to operation S425 shown in FIG. 4,the detailed descriptions thereof are omitted here.

In operation S750, when the interest level of the user of the firstdevice 100 in the content reproduced by the second device 200 is equalto or greater than the predetermined value, the first device 100 mayrequest the second device 200 for a recommendation item. For example,when the probability that the user of the first device 100 might viewthe content reproduced by the second device 200 is equal to or greaterthan 85%, the first device 100 may request the second device 200 for therecommendation item related to the reproduced content.

On the other hand, when the probability that the user of the firstdevice 100 might view the content reproduced by the second device 200 isless than the predetermined value, the first device 100 may not requestthe second device 200 for the recommendation item.

In the present exemplary embodiment, the first device 100 in apredetermined context may estimate (or may determine), withoutcalculating the interest level, that the interest level of the user ofthe first device 100 on the content reproduced by the second device 200is equal to or greater than the predetermined value. In this case, thefirst device 100 may request the second device 200 for therecommendation item.

For example, when the first device 100 has a purchase history ofpurchasing a ticket to view content reproduced by the second device 200,or has a check-in history with respect to checking-in to a service zoneof the second device 200, the first device 100 may determine that theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than thepredetermined value, and may request the second device 200 for therecommendation item.

In operation S760, the second device 200 may generate the recommendationitem related to the content reproduced by the second device 200. Forexample, the second device 200 may generate a resume item by using acaptured image (i.e., a last screen image) obtained by capturing ascreen and reproduction position information (e.g., link information orindex information) of the content. Also, the second device 200 maygenerate an additional information item by using additional informationof the reproduced content or may generate an application item by usingapplication information corresponding to the reproduced content. Here,the second device 200 may generate the recommendation item in the formof an object for using a service or in the form of a list. However, themethod for generating the recommendation item is not limited thereto.

In operation S770, the first device 100 may receive the recommendationitem. In the present exemplary embodiment, the first device 100 mayperiodically receive the recommendation item from the second device 200.

In operation S780, the first device 100 may sense an exit of the firstdevice 100 from the service zone of the second device 200. If the firstdevice 100 does not exit from the service zone of the second device 200,the first device 100 may not display the recommendation item on ascreen, and may request again and receive a recommendation item from thesecond device 200 (repetition of operations S750 through S770).

In operation S790, when the first device 100 senses the exit of thefirst device 100 from the service zone of the second device 200, thefirst device 100 may display on the screen the recommendation itemrelated to the content reproduced by the second device 200. In a casewhere the first device 100 periodically receives a recommendation itemfrom the second device 200, the first device 100 may display on thescreen a recommendation item that is lastly received by the first devicebefore the first device 100 senses the exit of the first device 100 fromthe service zone of the second device 200. In the present exemplaryembodiment, the screen may include a first screen.

According to the present exemplary embodiment, the first device 100 mayperform a context analysis and then, only when there is a highprobability that the user of the first device 100 views the contentreproduced by the second device 200, the first device 100 may requestthe second device 200 for the recommendation item related to the contentreproduced by the second device 200.

The first device 100 may display the recommendation item on the screen,in consideration of context information.

For example, when the first device 100 senses a gesture of the user ofthe first device 100 that requests the recommendation item, the firstdevice 100 may display the recommendation item on the screen. Thegesture for requesting the recommendation item may vary.

Additionally, the first device 100 may display the recommendation itemon the screen, based on luminance information, tilt information, etc.For example, when a luminance of the first device 100 is less than apredetermined value, the first device 100 may not display therecommendation item on the screen, and when the luminance of the firstdevice 100 is equal to or greater than the predetermined value, thefirst device 100 may display the recommendation item on the screen.

That is, in a case where the user of the first device 100 keeps thefirst device 100 in a pocket of the user, or does not carry the firstdevice 100 in the hand of the user, it may mean that the user may nothave an intention to receive the recommendation item. Thus, the firstdevice 100 may not display the recommendation item on the screen, basedon the luminance information or the tilt information.

On the other hand, when the first device 100 exits the service zone ofthe second device 200, if the user of the first device 100 stares at thescreen of the first device while the user holds the first device 100 inthe user's hand, the first device 100 may display on the screen therecommendation item related to the content reproduced by the seconddevice 200.

The first device 100 may display the recommendation item according to auser-designated setting. For example, the first device 100 may providethe recommendation item in the form of a pop-up window or may displaythe recommendation item on a specific page.

The first device 100 may scan the service zone of the second device 200that the first device 100 previously visited, and the scan may beperformed within a predetermined range with respect to a currentposition of the first device. When the service zone of the second device200 that the first device 100 previously visited is scanned, the firstdevice 100 may extract a recommendation item related to content that waspreviously reproduced by the second device 200 and may display therecommendation item on the screen.

FIG. 8 is a flowchart of a method of providing a recommendation item,the method performed by the second device 200, according to an exemplaryembodiment. In this regard, repeated detailed descriptions of sameoperations of the method of FIG. 7 are omitted here.

In operation S810, the first device 100 and the second device 200 may beable to communicate with each other. In operation S820, the seconddevice 200 may reproduce content. In operation S830, the second device200 may receive from the first device 100 a request for a recommendationitem related to the content reproduced by the second device 200.

In operation S840, the second device 200 may generate the recommendationitem. For example, the second device 200 may generate an applicationitem, a resume item, an additional information item, or an advertisementitem as the recommendation item corresponding to the reproduced content,but one or more exemplary embodiments are not limited thereto.

In operation S850, the second device 200 may transmit the recommendationitem to the first device 100.

In operation S860, the first device 100 may sense an exit of the firstdevice 100 from a service zone of the second device 200. If the firstdevice 100 does not exit from the service zone of the second device 200,the first device 100 may again request and receive a recommendation itemfrom the second device 200 (repetition of operations S830 through S850).For example, when the first device 100 does not exit from the servicezone of the second device 200, the first device 100 may periodicallyreceive a recommendation item that is updated in the second device 200.

In operation S870, when the first device 100 senses the exit of thefirst device 100 from the service zone of the second device 200, thefirst device 100 may calculate an interest level of the user of thefirst device 100 on the content reproduced by the second device 200,based on a plurality of pieces of event information that are received bythe first device 100.

In operation S880, the first device 100 may determine whether theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than apredetermined value.

For example, the first device 100 may determine whether a probabilitythat the user of the first device 100 might view the content reproducedby the second device 200 is equal to or greater than 90%. When theprobability that the user of the first device 100 might view the contentreproduced by the second device 200 is less than the predetermined value(e.g., less than 90%), the first device 100 may not display on a screenthe recommendation item received from the second device 200.

In operation S890, when the calculated interest level of the user isequal to or greater than the predetermined value (e.g., 90%), the firstdevice 100 may display on the screen the recommendation item receivedfrom the second device 200.

According to the present exemplary embodiment, in a case where arecommendation item is periodically received, the first device 100 maydisplay on the screen a recommendation item that is lastly received bythe first device before the first device 100 senses the exit of thefirst device 100 from the service zone of the second device 200.

The first device 100 may display the recommendation item on the screen,in consideration of context information. Operation S890 corresponds tooperation S790 of the method of FIG. 7, thus, detailed descriptionsthereof are omitted here.

Hereinafter, a case in which, when the first device 100 exits a servicezone of the second device 200, the first device 100 directly generatesand displays a recommendation item related to content reproduced by thesecond device 200 will be described in detail with reference to FIGS. 9and 10.

FIG. 9 illustrates a method of displaying a recommendation item, themethod performed by the first device 100, according to another exemplaryembodiment.

In operation S910, the second device 200 may reproduce content. Then, inoperation S920, the second device 200 may broadcast information aboutthe content reproduced by the second device 200. For example, the seconddevice 200 may periodically broadcast at least one of a captured imageobtained by capturing a screen that reproduces the content, reproductionposition information (e.g., a URI, URL, etc.) indicating a reproductionposition or location of the content that is reproduced when captured,application information corresponding to the content, additionalinformation about the content, and advertisement informationcorresponding to the content.

In operation S930, the first device 100 positioned in a service zone 900of the second device 200 may obtain the information about the contentreproduced by the second device 200. That is, according to the presentexemplary embodiment, the first device 100 may log in the informationabout the content reproduced by the second device 200 while the firstdevice 100 is positioned in the service zone 900 of the second device200.

In operation S940, the first device 100 may sense an exit of the firstdevice 100 from the service zone 900 of the second device 200.

For example, when communication with the second device 200 isdiscontinued, the first device 100 may sense the exit of the firstdevice from the service zone 900 of the second device 200.

Additionally, when the first device 100 recognizes or senses an externaldevice (e.g., an NFC tag, a BLE tag, etc.) located outside of theservice zone 900 of the second device 200, or at a boundary of theservice zone 900 of the second device 200, the first device 100 maydetermine that the first device has exited the service zone 900 of thesecond device 200.

When the first device 100 previously stores information about theservice zone 900 of the second device 200, or receives the informationabout the service zone 900 of the second device 200 from the seconddevice 200, the first device 100 may sense the exit of the first devicefrom the service zone 900 of the second device 200 by using positioninformation of the first device 100.

In operation S950, the first device 100 may generate a recommendationitem, based on the information about the content which is received fromthe second device 200. For example, the first device 100 may generate aresume image related to the content reproduced by the second device 200,by using the captured image and the reproduction position informationthat are lastly received before the exit of the first device is sensed.Then, the first device 100 may generate an application item, anadditional information item, and an advertisement item that are relatedto the content reproduced by the second device 200.

The first device 100 may display the recommendation item on a screen ofthe first device 100. In the present exemplary embodiment, the screenmay include a first screen.

The first device 100 may generate the recommendation item and then mayimmediately display the recommendation item on the screen, or maydisplay the recommendation item on the screen only when the first device100 senses a gesture of the user that requests the recommendation item.

That is, according to the present exemplary embodiment, the first device100 may log in the information about the content reproduced by thesecond device 200 while the first device 100 is positioned in theservice zone 900 of the second device 200, and when the first device 100exits the service zone 900 of the second device 200, the first device100 may display on the screen (e.g., the first screen) therecommendation item related to the content reproduced by the seconddevice 200. This process will be described in detail with reference toFIG. 10.

FIG. 10 is a flowchart of a method of displaying a recommendation item,the method performed by the first device 100, according to anotherexemplary embodiment. In this regard, repeated detailed descriptions ofsame operations of the method of FIG. 9 are omitted here.

In operation S1010, the second device 200 may reproduce content.

In operation S1020, the second device 200 may broadcast information(e.g., an image, reproduction position information, additionalinformation, advertisement information, application information, etc.)about the reproduced content.

In operation S1030, the first device 100 positioned in a service zone ofthe second device 200 may obtain the information about the contentreproduced by the second device 200. The first device 100 may manage thereceived information about the content.

In operation S1040, the first device 100 may sense an exit of the firstdevice 100 from the service zone of the second device 200. The sensingmethod performed by the first device 100 is already described above andthus detailed descriptions thereof are omitted here.

If the first device 100 does not exit from the service zone of thesecond device 200, the first device 100 may keep collecting a pluralityof pieces of the information about the content which are broadcast fromthe second device 200.

In operation S1050, when the first device 100 senses the exit of thefirst device 100 from the service zone of the second device 200, thefirst device 100 may calculate an interest level of a user of the firstdevice 100 in the content reproduced by the second device 200, based ona plurality of pieces of event information that are received by thefirst device 100.

In operation S1060, the first device 100 may determine whether theinterest level of the user of the first device 100 in the contentreproduced by the second device 200 is equal to or greater than apredetermined value (e.g., 70%). As a result of the determination, whenthe interest level of the user of the first device 100 in the contentreproduced by the second device 200 is less than the predetermined value(e.g., 70%), the first device 100 may not generate the recommendationitem.

In operation S1070, when the calculated interest level is equal to orgreater than the predetermined value (e.g., 70%), the first device 100may generate the recommendation item, based on the information about thecontent which is received from the second device 200.

In operation S1080, the first device 100 may display the recommendationitem on a screen (e.g., a first screen).

In the present exemplary embodiment, while the first device 100 is inthe service zone of the second device 200, the first device 100 maycontinue to receive the information about the content reproduced by thesecond device 200, and when the first device 100 exits the service zoneof the second device 200, the first device 100 may generate therecommendation item related to the content reproduced by the seconddevice 200, and may display the recommendation item on the screen.

Also, according to the present exemplary embodiment, the first device100 may perform a context analysis and therefore, when there is a highprobability that the user of the first device 100 might view the contentreproduced by the second device 200, the first device 100 may generatethe recommendation item related to the content reproduced by the seconddevice 200 and may display the recommendation item on the screen so asto allow the user to continuously use the content reproduced by thesecond device 200 although the user exits the service zone of the seconddevice 200.

FIGS. 11A and 11B illustrate screens for displaying one or morerecommendation items, according to an exemplary embodiment.

As illustrated in FIG. 11A, the first device 100 may display on a screenrecommendation items in the form of a list, wherein the recommendationitems are related to a plurality of pieces of content that arereproduced by a plurality of second devices 200. That is, therecommendation items may be related to the plurality of pieces ofcontent reproduced by a plurality of second devices 200, each of whichis different from each other. For example, in a case where a user goesto a theater by bus, watches a movie, and then comes back home bysubway, the first device 100 may display a list of a firstrecommendation item related to animation content reproduced in the bus,a second recommendation item related to movie content shown in thetheater, and a third recommendation item related to advertisementcontent reproduced in a subway station or in a subway train.

The first device 100 may array the list of recommendation items in atime-sequential order according to generation times of therecommendation items, or may array the list of recommendation items inan order according to time periods in which the first device 100 stayedin the service zones.

The first device 100 may sense a user selection with respect to arecommendation item 1100 related to movie content titled “Kung Fu Panda”from the list of recommendation items. The recommendation item 1100related to movie content titled “Kung Fu Panda” may be a resume item inwhich link information or index information is connected with a capturedimage that is obtained at a point of time when the first device 100exits a service zone of the second device 200.

For example, when the user of the first device 100 watches the moviecontent “Kung Fu Panda” in an airplane and then gets off the airplane atthe user's destination, the first device 100 may sense that the user hasleft the airplane and then may display on a screen a resume item forallowing the user to resume reproduction of the movie content “Kung FuPanda” that the user watched before getting off the airplane. In one ormore exemplary embodiments, the resume item may be generated by themanagement server 300, the second device 200, or the first device 100.

As illustrated in FIG. 11B, when the user of the first device 100selects the recommendation item 1100 related to the movie content titled“Kung Fu Panda”, the first device 100 may check the link information orthe index information included in the recommendation item 1100.Afterward, based on the checked link information or the checked indexinformation, the first device 100 may resume reproduction of the contentafter the point of time when the first device 100 exits the service zoneof the second device 200. For example, the first device 100 may resumereproduction of the movie content “Kung Fu Panda” that the user did notcomplete watching due to getting off the airplane.

FIGS. 12A, 12B and 12C illustrate a method of receiving a recommendationitem from an external device and displaying the recommendation item, themethod performed by the first device 100, according to an exemplaryembodiment.

As illustrated in FIG. 12A, the first device 100 may sense a usergesture for requesting recommendation items that are displayed on one ormore external devices 400-1, 400-2, and 400-3. Here, in response to theuser gesture, the first device 100 may transmit signals to the one ormore external devices 400-1, 400-2, and 400-3 so as to request therecommendation items.

As illustrated in FIG. 12B, the first device 100 may receive from theone or more external devices 400-1, 400-2, and 400-3 the recommendationitems that are displayed on the one or more external devices 400-1,400-2, and 400-3. Then, the first device 100 may add the recommendationitems received from the one or more external devices 400-1, 400-2, and400-3 to a predetermined screen (or a predetermined page) and maydisplay the recommendation items.

The user may check the recommendation items (e.g., a recommendation item1, a recommendation item 2, and a recommendation item 3) received fromthe one or more external devices 400-1, 400-2, and 400-3, and may deletesome of the recommendation items (e.g., the recommendation item 2). Thatis, in a case where the first device 100 senses a deletion requestgesture with respect to the recommendation item 2, the first device 100may delete the recommendation item 2 from a list of the recommendationitems. The deletion request gesture may vary. For example, an example ofthe deletion request gesture may include, but is not limited to, a swipegesture, a flick gesture, a tap gesture, and a drag and drop gesture.

As illustrated in FIG. 12C, the first device 100 may delete from thelist of the recommendation items the recommendation item 2 to which thedeletion request gesture is sensed, and may re-array the list of therecommendation items.

FIGS. 13A through 13C illustrate a method of sharing a recommendationitem with an external device, the method performed by the first device100, according to an exemplary embodiment.

As illustrated in FIG. 13A, the first device 100 may receive, from auser, a share request for a recommendation item shared with the externaldevice.

As illustrated in FIG. 13B, in response to the share request from theuser, the first device 100 may display a list of one or more externaldevices (e.g., a living room TV, a room TV 1300, a display of arefrigerator, a brother's mobile phone, etc.) capable of sharing therecommendation item. The one or more external devices may be scannedaround the first device 100 via short-distance communication (e.g.,Bluetooth communication, Wi-Fi communication, etc.). Also, according tothe present exemplary embodiment, the one or more external devices maybe universal plug and play (UPnP)-based scanned.

The first device 100 may sense user selection of the living room TV 1300from the list of one or more external devices (e.g., the living room TV1300, the room TV, the display of refrigerator, the sister's mobilephone, etc.).

As illustrated in FIG. 13C, the first device 100 may transmit to theliving room TV 1300 the recommendation item that the user wants toshare. Here, the first device 100 may perform a procedure ofauthenticating the living room TV 1300. For example, the first device100 may authenticate whether the living room TV 1300 is capable ofdisplaying the recommendation item, based on authentication information,ID information of the living room TV 1300, etc. that are received fromthe living room TV 1300.

The living room TV 1300 that has received the recommendation item fromthe first device 100 may display the received recommendation item on itsscreen. Then, the living room TV 1300 may receive a user selection withrespect to the recommendation item. If the recommendation item receivedfrom the first device 100 is a resume item, the living room TV 1300 mayresume reproduction of content.

If the recommendation item received from the first device 100 is anadditional information item related to movie content, the living room TV1300 may display on the screen a plurality of pieces of additionalinformation such as a video on demand (VOD) purchase, an originalsoundtrack (OST) purchase, a production note viewing, etc. that arerelated to the movie content.

FIGS. 14A and 14B illustrate a method of providing a recommendation itemrelated to content reproduced by public transportation, the methodperformed by the first device 100, according to an exemplary embodiment.

As illustrated in FIG. 14A, in a case where a user views content byusing a display device 1400 available in an airplane and then gets offthe airplane at the destination, the user may no longer view thecontent.

Here, as illustrated in FIG. 14B, the first device 100 may sense thatthe first device 100 exits a service zone of the display device 1400available in the airplane, and may display on a screen a recommendationitem related to the content reproduced by the display device 1400.

FIGS. 15A, 15B, and 15C illustrate a method of providing arecommendation item related to movie content shown in a theater, themethod performed by the first device 100, according to an exemplaryembodiment.

As illustrated in FIG. 15A, a user may watch a movie via the seconddevice 200 in the theater, and then may leave the theater beforereproduction of the movie is completed. In this case, the first device100 may recognize an external device (e.g., an NFC tag, a BLE tag, etc.)positioned at an entrance of the theater and therefore may determinethat the first device 100 has exited from a service zone of the seconddevice 200.

As illustrated in FIG. 15B, the first device 100 may provide a resumeitem to a screen of the first device 100 so as to allow the user of thefirst device 100 to resume reproduction of the content from a point oftime when the user of the first device 100 exits the service zone of thesecond device 200, wherein the content is reproduced by the seconddevice 200. By doing so, the user may continue watching the rest of thecontent that the user could not watch in the theater.

As illustrated in FIG. 15C, the first device 100 may transmitrecommendation items (e.g., an additional information item and anadvertisement item) to an external device (e.g., a home TV 1500). Inthis case, the user may check additional information related to thecontent shown in the theater, via the home TV 1500.

FIGS. 16A, 16B, 16C, and 16D illustrate a method of providing arecommendation item related to sports content played in a sportscomplex, according to an exemplary embodiment.

As illustrated in FIG. 16A, a user may watch a baseball game in abaseball stadium. Then, the user may check details of the baseball gamevia an electric signboard 1610 in the baseball stadium

As illustrated in FIGS. 16B and 16C, when the user leaves the stands fora moment in the middle of the baseball game, the first device 100 mayrecognize an external device (e.g., an NFC tag, a BLE tag, etc.) 1620located outside of the stands or at a boundary of the stands, andtherefore may sense that the user has left the stands. In this case, thefirst device 100 may display an additional information item related tothe details of the baseball game that are displayed on the electricsignboard 1610, an application item for relaying the baseball game, orthe like as a recommendation item on a screen.

As illustrated in FIG. 16D, although the user leaves the stands, theuser may continue checking the details of the baseball game via thefirst device 100.

FIGS. 17A and 17B are block diagrams illustrating a configuration of thefirst device 100, according to an exemplary embodiment.

As illustrated in FIG. 17A, the first device 100 may include acommunication device 110, a sensor 130, and a controller 160 (alsoreferred as a processor 160). However, not all shown elements arenecessary elements. That is, the first device 100 may be embodied withmore or less elements than the shown elements.

For example, as illustrated in FIG. 17B, the first device 100 mayinclude the communication device 110, an output device 120, the sensor130, a user input device 140, an audio/video (A/V) input device 150, thecontroller 160, and a memory 170.

Hereinafter, the aforementioned elements are described.

The communication device 110 may include one or more elements forallowing communication between the first device 100 and the seconddevice 200 or communication between the first device 100 and themanagement server 300. For example, the communication device 110 mayinclude a mobile communication device 111, a short-distancecommunication device 112, a position information device 113, and awireless communication device 114.

Also, the mobile communication device 111 exchanges a wireless signalwith at least one of a base station, an external terminal, and a serverthrough a mobile communication network. Here, the wireless signal mayinclude a voice call signal, a video call signal, or various types ofdata according to an exchange of text/multimedia messages.

The short-distance communication device 112 is arranged forshort-distance communication. In the present exemplary embodiment,examples of the short-distance communication may include, but are notlimited to, Wi-Fi, Bluetooth, ZigBee, WFD, UWB, infrared DataAssociation (IrDA), and BLE.

The position information device 113 is arranged to check or obtain aposition of the first device 100. An example of the position informationdevice 113 may include a GPS module. The GPS module receives a pluralityof pieces of position information from a plurality of satellites. Here,each of the plurality of pieces of position information may includeinformation about coordinates consisting of latitude and longitude. Inparticular, the GPS module may obtain from the position information notonly a position of latitude, longitude, and height but also may obtainthree-dimensional (3D) speed information and exact time.

The wireless communication device 114 is for accessing the Internet orother networks wirelessly, and may be embedded in the first device 100or may be arranged outside the first device 100.

The output device 120 may function to output an audio signal, a videosignal, or a vibration signal, and may include a display 121, a soundoutput device 122, a vibration motor 123, or the like.

The display 121 displays and outputs information that is processed inthe first device 100. For example, the display 121 may display on ascreen (e.g., a first screen) a recommendation item related to contentreproduced by the second device 200. Also, the display 121 may displayon the screen another recommendation item that is received from anexternal device.

When the display 121 and a touch pad form a mutual layer structure andthen are formed as a touch screen, the display 121 may be used as bothan output device and input device. The display 121 may include at leastone of a liquid crystal display (LCD), a thin film transistor-liquidcrystal display (TFT-LCD), an organic light-emitting diode display, aflexible display, a 3D display, and an electrophoretic display, but isnot limited thereto. Also, according to a type of the first device 100,the first device 100 may include at least two displays 121. Here, the atleast two displays 121 may face each other by using a hinge.

In the present exemplary embodiment, the display 121 may be arranged inan external device connected with the first device 100. The externaldevice may include an input device, an output device, a control device,and the like.

The display 121 may be included in a user's glasses. In this case, thefirst device 100 may display the recommendation item through the user'sglasses.

The sound output device 122 may output audio data that is received fromthe communication device 110 or is stored in the memory 170. The soundoutput device 122 may also output a sound signal (e.g., a call signalreceiving sound, a message receiving sound, or the like) related tocapabilities performed by the first device 100. The sound output device122 may include a speaker, a buzzer, or the like.

The vibration motor 123 may output a vibration signal. For example, thevibration motor 123 may output the vibration signal that corresponds toan output of the audio data (e.g., the call signal receiving sound, themessage receiving sound, or the like) or video data. Also, when a touchis input to the touch screen, the vibration motor 123 may output avibration signal, and when the first device 100 exits a service zone ofthe second device 200, the vibration motor 123 may output a vibrationsignal.

The sensor 130 may collect a plurality of pieces of event informationabout events that occur in the first device 100. For example, the sensor130 may sense a position of the first device 100, user's stateinformation, application information about at least one application usedin the first device 100, exchanged message information, exchanged emailinformation, call history information, SNS use information, webpage useinformation, transaction information, a user's eyes-position, or thelike.

The sensor 130 may also sense whether the first device 100 exits theservice zone of the second device 200. For example, the sensor 130 maysense that communication with the second device 200 is disconnected.Also, the sensor 130 may recognize an external device located outside ofthe service zone, or at a boundary of the service zone of the seconddevice 200.

The sensor 130 may sense how far (e.g., about an N km) the first device100 is from the service zone of the second device 200, by usinginformation of Wi-Fi, GPS, a communication network base station, etc.Also, when a user performs a check-in procedure in the service zone ofthe second device 200 by using the first device 100, the sensor 130 mayestimate a movement distance to which the first device 100 moves from aposition of the check-in, by using an acceleration sensor.

The sensor 130 may include various sensors so as to collect theplurality of pieces of event information. For example, the sensor 130may include, but is not limited to, an acceleration sensor, a tiltsensor, a gyro sensor, a 3-axis magnetic sensor, a voice recognitionsensor, a luminance sensor, a temperature sensor, an image sensor (e.g.,a camera), and a touch sensor.

The sensor 130 may interoperate with a seamless sensing platform (SSP)10. The SSP 10 may include a sensor hub and an SSP manager. Here, thesensor 130 may be connected to the sensor hub, and the SSP manager maybe included in a framework of an application processor (AP) 161.

Thus, the sensor hub may collect a plurality of pieces of sensinginformation (i.e., the plurality of pieces of event information aboutthe events occurring in the first device 100) via the sensor 130. Here,in a case where the AP 161 in a sleep mode has to be active (e.g., in acase where the sensor 130 senses the exit from the service zone of thesecond device 200), the sensor hub may transmit an interrupt signal tothe SSP manager so as to inform the SSP manager of data to betransmitted.

The SSP manager may transmit a signal requesting the sensor hub for atype and length of the data to be transmitted by the sensor hub. In thiscase, the sensor hub may transmit to the SSP manager a signal includingthe type and length of the data to be transmitted. The SSP manager maytransmit a start-to-read message to the sensor hub, and when the sensorhub receives the start-to-read message, the sensor hub may processsensing data to a predefined packet and then may transmit the packet tothe SSP manager.

In the present exemplary embodiment, the sensor 130 may be arranged inan external device that is connected with the first device 100. Theexternal device may be related to an application that is executed in thefirst device 100. In another exemplary embodiment, one or more externaldevices may be arranged. The first device 100 may control the externaldevice by using the application.

The first device 100 may receive from the external device data that issensed by the sensor 130 arranged in the external device. For example,in a case where the temperature sensor is embedded in a watch, and theacceleration sensor is embedded in a belt, the first device 100 mayreceive temperature information from the watch and may receiveacceleration information from the belt. Here, the watch and the belt maybe controlled via an application installed in the first device 100.

According to the present exemplary embodiment, the various sensors maybe separately embedded in peripheral devices so that power consumptionof the first device 100 may be decreased.

The user input device 140 may be a device by which the user inputs dataso as to control the first device 100. The user input device 140 mayinclude a key pad, a dome switch, a touch pad (a touch capacitive typetouch pad, a pressure resistive type touch pad, an infrared beam sensingtype touch pad, a surface acoustic wave type touch pad, an integralstrain gauge type touch pad, a Piezo effect type touch pad, or thelike), a jog wheel, and a jog switch, but one or more exemplaryembodiments are not limited thereto.

The A/V input device 150 may be arranged to receive an input of an audiosignal or a video signal and may include a camera 151, a microphone 152,or the like. The camera 151 may obtain an image frame such as a stillimage or a moving picture via an image sensor in a video call mode or aphotographing mode. The image captured via the image sensor may beprocessed by the controller 160 or a separate image processing device(not shown). The processed image frame may be displayed on the display121, may be stored in the memory 170, or may be transmitted to anexternal source via the communication device 110. According to aconfiguration of the first device 100, at least two cameras 151 may bearranged.

The microphone 152 may receive an input of an external voice signal in acall mode, a recording mode, or a voice recognition mode, and mayprocess the voice signal into electrical voice data. In the call mode,the processed voice data may be converted to be transmitted to a mobilecommunication base station via the mobile communication device 111 andthen may be output.

The controller 160 may generally control all operations of the firstdevice 100. That is, the controller 160 may execute programs stored inthe memory 170 and therefore may control the communication device 110,the output device 120, the sensor 130, the user input device 140, theA/V input device 150, the memory 170, or the like.

The controller 160 may include the AP 161 and a communication processor162. The AP 161 may control execution of various applications stored inthe memory 170. The communication processor 162 may control variouscommunication functions. In the present exemplary embodiment, the AP 161and the communication processor 162 may be integrally embodied as onehardware device or separately embodied as independent hardware devices.

The memory 170 may store a program to process and to control thecontroller 160, or may store a plurality of pieces of data (e.g., arecommendation item, information about content, sensing information,etc.) that are input/output.

The memory 170 may include at least one storage medium from among aflash memory-type storage medium, a hard disk-type storage medium, amultimedia card micro-type storage medium, card-type memories (e.g., anSD card, an XD memory, and the like), Random Access Memory (RAM), StaticRandom Access Memory (SRAM), Read-Only Memory (ROM), ElectricallyErasable Programmable Read-Only Memory (EEPROM), Programmable Read-OnlyMemory (PROM) magnetic memory, a magnetic disc, and an optical disc.Also, the first device 100 may drive a web storage that performs astoring function of the memory 170 via the Internet.

The programs stored in the memory 170 may be classified into a pluralityof modules according to their functions, for example, into a UI module171, a touch screen module 172, a context analysis module 173, arecommendation item managing module 174, or the like.

The UI module 171 may provide a UI or graphical user interface (GUI)which are specialized according to applications. The touch screen module172 may detect a user's touch gesture on the touch screen and maytransmit information related to the touch gesture to the controller 160.The touch screen module 172 may be configured as a separate controller(hardware)

Various sensors may be arranged in or near the touch screen so as todetect a touch or a proximate touch on the touch sensor. An example ofthe sensor to detect the touch on the touch screen may be a tactilesensor. The tactile sensor detects a contact of a specific object by atleast as much as a person can detect. The tactile sensor may detectvarious types of information such as the roughness of a contact surface,the hardness of the contact object, the temperature of a contact point,or the like.

The touch gesture of the user may include a tap gesture, a touch & holdgesture, a double tap gesture, a drag gesture, a panning gesture, aflick gesture, a drag & drop gesture, or the like.

“Tapping” is a user's motion of touching a screen by using a finger or atouch tool such as an electronic pen and then instantly lifting thefinger or touch tool from the screen without moving.

“Touching & holding” is a user's motion of touching a screen by using afinger or a touch tool such as an electronic pen and then maintainingthe above touching motion over a critical time (e.g., 2 seconds), aftertouching the screen. For example, a time difference between a touch-intime and a touch-out time is greater than or equal to the critical time,for example, 2 seconds. When a touch input lasts more than the criticaltime, in order to inform the user whether the touch input is tapping ortouching & holding, a feedback signal may be provided in a visual,acoustic, or tactile manner. The critical time may vary according to theexemplary embodiments.

“Double tapping” is a user's motion of touching the screen twice byusing the finger or touch tool (such as a stylus pen).

“Dragging” is a user's motion of touching the screen by using the fingeror touch tool and moving the finger or touch tool to another position onthe screen while keeping the touching motion. The dragging motion mayenable the moving or panning motion of an object.

“Panning” is a user's motion of performing a dragging motion withoutselecting an object. Since no object is selected in the panning motion,no object is moved in a page but the page itself is moved on the screenor a group of objects may be moved within a page.

“Flicking” is a user's motion of performing a dragging motion over acritical speed, for example, 100 pixel/s, by using the finger or touchtool. The dragging (panning) motion or the flicking motion may bedistinguished based on whether the moving speed of the finger or touchtool is over the critical speed, for example, 100 pixel/s, or not.

“Dragging & Dropping” is a user's motion of dragging an object to apredetermined position on the screen by using the finger or touch tooland then dropping the object at that position.

“Pinching” is a user's motion of moving two fingers touching the screenin opposite directions. The pinching motion is a gesture to magnify(open pinch) or contract (close pinch) an object or a page. Amagnification value or a contraction value is determined according tothe distance between the two fingers.

“Swiping” is a user's motion of touching an object on the screen byusing the finger or touch tool and simultaneously moving the objecthorizontally or vertically by a predetermined distance. A swiping motionin a diagonal direction may not be recognized as a swiping event.

The memory 170 may include a voice recognition module (not shown) thatrecognizes a voice of the user by using a voice recognition engine andtransmits the recognized voice to the controller 160.

The context analysis module 173 may analyze a context, based on theplurality of pieces of event information collected by the sensor 130.For example, the context analysis module 173 may calculate an interestlevel of the user of the first device 100 in the content reproduced bythe second device 200. In the present exemplary embodiment, the contextanalysis module 173 may calculate the interest level of the user of thefirst device 100 in the content reproduced by the second device 200,based on input information of the user, state information of the user,current position information, reservation history information, etc.

For example, when the user of the first device 100 performs a check-inprocedure with respect to the second device 200 or the service zone ofthe second device 200 by using the first device 100, the contextanalysis module 173 may calculate a high interest level of the user ofthe first device 100 in the content reproduced by the second device 200.

The context analysis module 173 may calculate a probability that theuser of the first device 100 might view the content reproduced by thesecond device 200, and therefore may calculate the interest level of theuser of the first device 100. Here, the context analysis module 173 maycalculate the probability that the user of the first device 100 mightview the content reproduced by the second device 200, based on the stateinformation of the user, the current position information, applicationinformation about an application executed in the first device 100, orthe like.

For example, when the user of the first device 100 downloads to thefirst device 100 data that is provided by the second device 200, orinputs recommendation information to the first device 100 so as torecommend the content reproduced by the second device 200 to anotheruser via an SNS, the context analysis module 173 may calculate a highprobability (e.g., about 95%) that the user of the first device 100might view the content reproduced by the second device 200.

Also, when a position of the first device 100 is not changed in theservice zone of the second device 200 over a predetermined time period,and an input of the user is not sensed over a predetermined time period,the context analysis module 173 may calculate a high probability (e.g.,about 90%) that the user of the first device 100 might view the contentreproduced by the second device 200.

On the other hand, although the first device 100 is positioned in theservice zone of the second device 200 over the predetermined timeperiod, while the first device 100 is positioned in the service zone ofthe second device 200, if the first device 100 receives from the user ofthe first device 100 an execution request with respect to an applicationthat is irrelevant to the content reproduced by the second device 200,the context analysis module 173 may calculate a low probability (e.g.,about 30%) that the user of the first device 100 might view the contentreproduced by the second device 200.

In the present exemplary embodiment, the context analysis module 173 maycalculate the interest level of the user of the first device 100 in thecontent reproduced by the second device 200, based on informationobtained by sensing the user's eyes via the camera 151.

When the first device 100 has a purchase history of purchasing a ticketwith respect to the content reproduced by the second device 200, or hasa check-in history with respect to the service zone of the second device200, the context analysis module 173 may determine that the interestlevel of the user of the first device 100 on the content reproduced bythe second device 200 is equal to or greater than a predetermined value.

In the present exemplary embodiment, the context analysis module 173 mayanalyze event information collected based on ontology, and thus mayobtain information about the interest level of the user of the firstdevice 100 on the content reproduced by the second device 200.

For example, the context analysis module 173 may obtain informationabout correlation between text/voice inputs by the user and the contentreproduced by the second device 200, based on ontology. Based on theinformation about the correlation between the text/voice inputs by theuser and the content reproduced by the second device 200, the contextanalysis module 173 may calculate the interest level of the user of thefirst device 100 on the content reproduced by the second device 200.

The recommendation item managing module 174 may manage recommendationitems that are received from the management server 300, the seconddevice 200, or the external device. Also, the recommendation itemmanaging module 174 may directly generate a recommendation item, basedon the information about the content which is received from the seconddevice 200.

FIG. 18 is a block diagram illustrating a configuration of the seconddevice 200, according to an exemplary embodiment.

As illustrated in FIG. 18, the second device 200 may include acommunication device 210, an output device 220, a user input device 230,a controller 240 (also referred as a processor 240), and a memory 250.However, not all shown elements are necessary elements. That is, thesecond device 200 may be embodied with more or less elements than theshown elements.

Hereinafter, the aforementioned elements are described.

The communication device 210 may include one or more elements forallowing communication between the second device 200 and the firstdevice 100, or communication between the second device 200 and themanagement server 300. For example, the communication device 210 mayinclude a mobile communication device 211, a short-distancecommunication device 212, a position information device 213, and awireless communication device 214.

In the present exemplary embodiment, examples of the short-distancecommunication may include, but are not limited to, Wi-Fi, Bluetooth,ZigBee, WFD, UWB, IrDA, BLE, and ANT+.

The communication device 210 may transmit information about content tothe first device 100 or the management server 300. Also, thecommunication device 210 may transmit a recommendation item related tothe content to the first device 100 or the management server 300.

The communication device 210 may periodically broadcast, viashort-distance communication, information about the management server300 which corresponds a recommendation item related to the contentreproduced by the second device 200. The information about themanagement server 300 may include link information (e.g., a URL) foraccessing the management server 300.

The output device 220 may function to output an audio signal, a videosignal, or a vibration signal and may include a display 221, a soundoutput device 222, a vibration motor 223, or the like.

The display 221 displays and outputs information that is processed inthe second device 200. For example, the display 221 may display on ascreen the content reproduced by the second device 200.

Also, the display 221 may display the information about the managementserver 300 which corresponds to the recommendation item related to thecontent reproduced by the second device 200, via a 2D barcode (e.g., aQR barcode), a color code, a gray code, etc.

When the display 221 and a touch pad form a mutual layer structure andthen are formed as a touch screen, the display 221 may be used as bothan output device and input device. The display 221 may include at leastone of an LCD, a TFT-LCD, an organic light-emitting diode display, aflexible display, a 3D display, and an electrophoretic display. Also,according to a type of the second device 200, the second device 200 mayinclude at least two displays 221.

The sound output device 222 outputs audio data that is received from thecommunication device 210 or is stored in the memory 250. The soundoutput device 222 outputs a sound signal related to functions that areperformed by the second device 200. The sound output device 222 mayinclude a speaker, a buzzer, or the like.

The vibration motor 223 may output a vibration signal. For example, thevibration motor 223 may output the vibration signal that corresponds toan output of the audio data or video data. Also, when a touch is inputto the touch screen, the vibration motor 223 may output a vibrationsignal.

The user input device 230 may be a device by which the user inputs dataso as to control the second device 200. The user input device 230 mayinclude a key pad, a dome switch, a touch pad (a touch capacitive typetouch pad, a pressure resistive type touch pad, an infrared beam sensingtype touch pad, a surface acoustic wave type touch pad, an integralstrain gauge type touch pad, a Piezo effect type touch pad, or thelike), a jog wheel, and a jog switch, but one or more exemplaryembodiments are not limited thereto.

The controller 240 may generally control all operations of the seconddevice 200. That is, the controller 240 may execute programs stored inthe memory 250 and therefore may control the communication device 210,the output device 220, the user input device 230, the memory 250, or thelike.

The memory 250 may store a program to process and to control thecontroller 240, or may store a plurality of pieces of data (e.g., arecommendation item, information about content, sensing information,etc.) that are input/output.

The memory 250 may include at least one storage medium from among aflash memory-type storage medium, a hard disk-type storage medium, amultimedia card micro-type storage medium, card-type memories (e.g., anSD card, an XD memory, and the like), RAM, SRAM, ROM, EEPROM, a PROMmagnetic memory, a magnetic disc, and an optical disc. Also, the seconddevice 200 may drive a web storage that performs a storing function ofthe memory 250 via the Internet.

The programs stored in the memory 250 may be classified into a pluralityof modules according to their functions, for example, into a UI module251, a content reproduction module 252, a recommendation item generationmodule 253, a content managing module 254, or the like.

The UI module 251 may provide a UI, a GUI, or the like that arespecialized according to a plurality of pieces of content orapplications. The content reproduction module 252 may reproduce content.Functions of the UI module 251 and the content reproduction module 252may be intuitionally deduced by one of ordinary skill in the art byreferring to names of the sensors, thus, detailed descriptions thereofare omitted here.

The recommendation item generation module 253 may generate arecommendation item related to the reproduced content. For example, therecommendation item generation module 253 may generate a resume item byusing a captured image of a screen reproducing the content, andreproduction position information indicating a reproduction position ofthe content at a point of time when the image is captured. Also, therecommendation item generation module 253 may generate an applicationitem, an advertisement item, an additional information item, or the likethat correspond to the reproduced content.

The content managing module 254 may manage the content reproduced by thesecond device 200, information about the content, or the like.

FIG. 19 is a block diagram illustrating a configuration of themanagement server 300 according to an exemplary embodiment.

As illustrated in FIG. 19, the management server 300 may include acommunication device 310, a controller 320, and a memory 330. However,not all shown elements are necessary elements. That is, the managementserver 300 may be embodied with more or less elements than the shownelements.

Hereinafter, the aforementioned elements are described.

The communication device 310 may include one or more elements forallowing communication between the management server 300 and the firstdevice 100 or communication between the management server 300 and thesecond device 200.

The communication device 310 may receive from the first device 100 arequest for a recommendation item related to content reproduced by thesecond device 200. The communication device 310 may request the seconddevice 200 for information about the content reproduced by the seconddevice 200 and may receive the requested information. The communicationdevice 310 may transmit to the first device 100 the recommendation itemrelated to the content reproduced by the second device 200.

The communication device 310 may transmit the recommendation itemrelated to the content to a cloud server that is connected to the firstdevice 100.

The controller 320 may generally control all operations of themanagement server 300. That is, the controller 320 may execute programsstored in the memory 330 and therefore may provide to the first device100 the recommendation item related to the content reproduced by thesecond device 200.

The memory 330 may store a program to process and to control thecontroller 320, or may store a plurality of pieces of data (e.g., arecommendation item, information about content, sensing information,etc.) that are input/output.

The programs stored in the memory 330 may be classified into a pluralityof modules according to their functions, for example, into a contextanalysis module 331, a recommendation item generation module 332, aservice zone managing module 333, or the like.

The context analysis module 331 may analyze a context, based on aplurality of pieces of event information collected by the first device100. For example, the context analysis module 331 may calculate aninterest level of the user of the first device 100 in the contentreproduced by the second device 200, a probability that the user of thefirst device 100 might view the content reproduced by the second device200, or the like. The context analysis module 331 may calculate theprobability that the user of the first device 100 might view the contentreproduced by the second device 200, based on input information of theuser, state information of the user, position information, reservationhistory information, etc.

When the first device 100 has a purchase history of purchasing a ticketto view the content reproduced by the second device 200, or has acheck-in history with respect to a service zone of the second device200, the context analysis module 331 may determine that the interestlevel of the user of the first device 100 in the content reproduced bythe second device 200 is equal to or greater than a predetermined value.

According to the present exemplary embodiment, the context analysismodule 331 may analyze the plurality of pieces of event informationcollected by the first device 100 based on ontology, and thus mayanalyze the interest level of the user of the first device 100 on thecontent reproduced by the second device 200.

For example, the context analysis module 331 may obtain correlationinformation about correlation between text/voice inputs by the user andthe content reproduced by the second device 200, based on ontology, andthen, may calculate the interest level of the user of the first device100 on the content reproduced by the second device 200, by using thecorrelation information.

The recommendation item generation module 332 may generate therecommendation item related to the content reproduced by the seconddevice 200 at a point of time when the first device 100 exits theservice zone of the second device 200, based on the information aboutthe content which is received from the second device 200.

The recommendation item generation module 332 may generate a resume itemby using captured image information obtained by capturing an image ofthe content reproduced by the second device 200 at the point of timewhen the first device 100 exits the service zone of the second device200, and reproduction position information about a reproduction positionof the content reproduced by the second device 200 at the point of timewhen the first device 100 exits the service zone of the second device200. Also, the recommendation item generation module 332 may generate anapplication item, an advertisement item, an additional information item,etc., as the recommendation item, which correspond to the reproducedcontent.

The service zone managing module 333 may manage a plurality of pieces ofinformation about the service zone of the second device 200 thatprovides a content reproduction service. For example, the service zonemanaging module 333 may manage a position of the second device 200, alocation of the service zone of the second device 200, ID information ofthe second device 200, the information about the content reproduced bythe second device 200, or the like.

According to the one or more exemplary embodiments, the first device 100that is a personal device of a user, allows the user of the first device100 to experience again via the first device 100 a service that the userexperienced before via another device other than the first device 100.

One or more exemplary embodiments may also be embodied as programmedcommands to be executed in various computer means, and then may berecorded to a computer-readable recording medium. The computer-readablerecording medium may include one or more of the programmed commands,data files, data structures, or the like. The programmed commandsrecorded to the computer-readable recording medium may be particularlydesigned or configured for one or more exemplary embodiments or may bewell known to one of ordinary skill in the art. Examples of thecomputer-readable recording medium include magnetic media including harddisks, magnetic tapes, and floppy disks, optical media including CD-ROMsand DVDs, magneto-optical media including floppy disks, and a hardwareapparatus designed to store and execute the programmed commands in ROM,RAM, a flash memory, and the like. Examples of the programmed commandsinclude not only machine codes generated by a compiler but also includegreat codes to be executed in a computer by using an interpreter. Thehardware apparatus may be configured to function as one or more softwaremodules so as to perform operations of one or more exemplaryembodiments, or vice versa.

It should be understood that the exemplary embodiments described thereinshould be considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each exemplaryembodiment should typically be considered as available for other similarfeatures or aspects in other exemplary embodiments.

While one or more exemplary embodiments have been described withreference to the figures, it will be understood by those of ordinaryskill in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the inventiveconcept as defined by the following claims.

What is claimed is:
 1. A first device configured to display informationrelated to content reproduced by a second device, the first devicecomprising: a sensor configured to detect an exit of the first devicefrom a service zone of the second device; a communicator configured tocommunicate with a server; and a controller configured to control thecommunicator to request the server for the information related to thecontent reproduced by the second device based on detecting the exit ofthe first device from the service zone of the second device and toreceive the requested information related to the content from theserver, and control a display of the first device to display theinformation related to the content received from the server.
 2. Thefirst device of claim 1, wherein the sensor is configured to detect adisconnection of communication between the first device and the seconddevice.
 3. The first device of claim 1, wherein the sensor is configuredto detect the exit of the first device from the service zone of thesecond device based on a recognition by an external device locatedoutside of the service zone of the second device, or located at aboundary of the service zone of the second device.
 4. The first deviceof claim 1, wherein the controller is configured to obtain an interestlevel of a user of the first device in the content reproduced by thesecond device, based on event information collected by the first device,and control the communicator to request the server for the informationrelated to the content via the communication device if the obtainedinterest level is equal to or greater than a predetermined value.
 5. Thefirst device of claim 4, wherein the controller is configured tocalculate a probability that the user of the first device will view thecontent reproduced by the second device, based on the event informationcollected by the first device.
 6. The first device of claim 1, whereinthe controller is configured to control the communicator to request theserver for the information related to the content by transmitting atleast one of information about the second device and information aboutthe service zone of the second device to the management server.
 7. Thefirst device of claim 1, wherein the information related to the contentcomprises an image of the content connected to at least one of linkinformation and index information.
 8. The first device of claim 1,wherein the information related to the content comprises at least one ofan application item corresponding to the content, a resume itemcorresponding to the content, an additional information itemcorresponding to the content, and an advertisement item corresponding tothe content.
 9. The first device of claim 1, wherein the controller isconfigured to control the display to display the information related tothe content on a first screen which is displayed when an operation modeof the first device is switched from a standby mode to an active mode.10. The first device of claim 1, wherein the service zone of the seconddevice comprises at least one of a communication area where the firstdevice communicates with the second device, and a viewing area where auser of the first device views the content reproduced by the seconddevice.
 11. A method of displaying information related to contentreproduced by a second device, the method performed by a first deviceand comprising: detecting an exit of the first device from a servicezone of the second device; requesting a server for the informationrelated to the content reproduced by the second device based ondetecting the exit of the first device from the service zone of thesecond device and to receive the requested information related to thecontent from the server; receiving the information related to thecontent from the server; and displaying the information related to thecontent received from the server.
 12. The method of claim 11, whereinthe first device comprises a personal mobile device, and wherein thesecond device comprises a public device.
 13. The method of claim 11,wherein the detecting of the exit of the first device comprisesdetecting a disconnection of communication between the first device andthe second device.
 14. The method of claim 11, wherein the detecting ofthe exit of the first device comprises recognizing the exit of the firstdevice by an external device located outside of the service zone of thesecond device or located at a boundary of the service zone of the seconddevice.
 15. The method of claim 11, wherein the requesting of theinformation related to the content comprises transmitting at least oneof information about the second device and information about the servicezone of the second device.
 16. The method of claim 11, wherein thedisplaying of the information related to the content comprisesdisplaying the information related to the content when an illuminancevalue outside the first device is equal to or greater than apredetermined value.
 17. A non-transitory computer-readable recordingmedium having recorded thereon a computer program for executing a methodperformed by a first device comprising: displaying an informationrelated to content reproduced by a second device; detecting an exit ofthe first device from a service zone of the second device; requesting aserver for the information related to the content reproduced by thesecond device based on detecting the exit of the first device from theservice zone of the second device and to receive the requestedinformation related to the content from the server; receiving theinformation related to the content from the server; and displaying theinformation related to the content received from the server.
 18. Thenon-transitory computer-readable recording medium of claim 17, whereinthe detecting of the exit of the first device comprises detecting adisconnection of communication between the first device and the seconddevice.
 19. The non-transitory computer-readable recording medium ofclaim 17, wherein the detecting of the exit of the first devicecomprises recognizing the exit of the first device by an external devicelocated outside of the service zone of the second device or located at aboundary of the service zone of the second device.
 20. Thenon-transitory computer-readable recording medium of claim 17, whereinthe requesting of the information related to the content comprisestransmitting at least one of information about the second device andinformation about the service zone of the second device.